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DOD’s  Move  to  a  More 
Professional  Acquisition 
Work  Force  , 

Edward  Hirsch, 

Brigadier  General, 

USA,  (ret) 

The  mission  of  the  Defense 
Systems  Management  College 
is  expanded  to  include  the 
entirety  of  acquisition 
management  as  now  reflected 
in  DODD  5000.1. 


Controlling  Contract 
Changes:  Keeping 
Contracts  Consistent 
With  Needs  \ 

Dr.  Alan  W.  Beck,  CPCM 

Good  change  management 
requires  top-quality  profes¬ 
sionals  understanding  rules 
and  process  and  dedicated  to 
getting  the  job  done  in  a  pro¬ 
fessional  and  timely  manner. 


Ten  Agenda  Items  for 
Improving  Defense 
Acquisition . 

The  Honorable 
Robert  B.  Costello 
Under  Secretary  of  Defense 
(Acquisition) 

Goals  and  strategies  intended 
to  streamline  DOD  methods 
of  conducting  business  and 
procedures  to  increase 
quality  and  reliability  while 
reducing  weapon  systems 
costs. 


Government  Contract 
Profit  Policy  And 
Defense , 

David  Westermann 

The  real  objective  in  negotia¬ 
tion  is  to  select  contractors 
who  will  produce  the  needed 
quality  and  reliability,  at  a 
reasonable  price,  and  low 
total  or  life-cycle  cost  to  the 
Government. 


Leadership  and 
Administration  in  the 
Technical  Environment 

Joseph  W.  Lee 

Why  a  proper  mixture  of 
personality  traits  and 
management  skills  are 
desirable  in  successful 
development  of  effective 
leadership  and  quest  for  the 
ideal  manager-leader. 


Can  This  Program  be 
Saved! 

Kenneth  B.  Stinson 

When  tasked  to  run  a 
troubled  program,  there  are 
actions  to  pursue  which  can 
lead  to  a  rewarding  career 
assignment. 
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Acquisition  Stream¬ 
lining:  Increasing 
Management  Control 

Alton  R.  Brown 
Judith  /.  Gordon 

How  management  control  of 
systems  acquisition  can  be 
increased  by  applying  fun¬ 
damental  management  skills 
to  streamlining. 


Running  a  Glass 
Company  Can  Makc 
You  a  Better  Manager: 
The  Looking  Glass 
Experience 

Michael  G.  Krause 

Searching  for  managerial  ex¬ 
cellence  can  be  challenging 
and  fun.  Students  at  the 
Defense  Systems  Manage¬ 
ment  College  can  participate 
in  a  top-rated  commercial 
simulation  of  a  50-year-old 
glass  company  with  eight 
plants,  4,000  employees  and 
$200  million  in  sales. 


Past  Acquisition 
Improvements : 

Not  Sufficient 

Dr.  Andrew  P  Master 

Second  of  a  series  on  how  to 
increase  productivity. 


Software  Testing 
Management 

John  B.  Burke , 

Captain,  USA 

Developing  a  baseline  of  in¬ 
formation  on  software  testing 
management. 


Baselining  of  Major 
Defense  Acquisition 
Programs:  Past,  Present 
And  Future 

Mr.  Joseph  A.  Ferrara 

After  initial  establishment  of 
baselines  for  major  pro¬ 
grams,  the  true  management 
challenge  will  be  effective 
administration. 


Data  Management: 

A  Statistical  Perspective 

Dr.  Jack  B.  BeVelle 
Dr.  Lane  B.  Blank 

There  is  no  substitute  for  a 
sound  knowledge  of  data  and 
common  sense  in  the  applica¬ 
tion  of  statistical  methods  to 
any  problem. 
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An  Approach  to 
Improve  Acquisition  of 
Support  Equipment 

Robert  E.  Schajrik, 

Lieutenant  Colonel ,  USAF 
Dr.  Norma  Flubele 
Dr.  Dan  Shunk 
Mr.  Do  Bernier 

A  significant  part  of  the 
logistics  system  is  the  equip¬ 
ment  required  for  weapon 
system  check-out, 
maintenance  and  repair. 
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To  Our  Readers. . . . 


Pngmnt  Manager  has  a  “new  look.”  This  May-June 
1988  issue  is  larger  and  more  technically  oriented— 
something  we  plan  for  each  calendar  year.  The 
remaining  bimonthly  issues  of  this  journal  of  the 
Defense  Systems  Management  College  will  not  exceed 
our  52-page  limit.  We  are  interested  in  your  comments 
and  welcome  letters  to  the  editors,  pro  and  con. 

This  Program  Manager  comprises,  among  other 
things,  management  theories  with  opinions  from 
experts;  a  look  at  past  acquisition  improvements; 
agenda  items  for  improving  the  acquisition  process; 
acquisition  streamlining;  facilitating  contractor 
productivity  while  increasing  management  control  by 
the  government;  baselining  for  all  times;  and 
something  of  which  we  are  proud,  the  expanded  role 
of  the  Defense  Systems  Management  College  in 
training  Program  Managers  for  U.S.  defense  systems. 

With  this  issue,  we  are  happy  to  welcome  Major 
General  Lynn  H.  Stevens,  USA,  as  the  tenth 
Commandant  of  the  Defense  Systems  Management 
College.  He  succeeds  Brigadier  General  Charles  P. 
Cabell,  Jr.,  USAF,  whose  ongoing  support  will  always 
be  deeply  appreciated. 


The  Staff 
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Briaadier  General  Edward  Hirscb ,  USA  (ret.) 


ritics  claim  the 
Department  of  De¬ 
fense  (DOD)  is  incapable  of 
self-generated  innovation 
and  that  interservice  coop¬ 
eration  is  sacrificed  in  favor 
of  preserving  Service  prerog¬ 
atives.  The  DOD  quietly 
and  effectively  proved  these 
criticisms  to  be  less  than  ac¬ 
curate.  As  a  result  of  actions 
predating  legislative  initiatives  and  blue  ribbon  panel  reports 
to  enhance  professionalism  of  the  acquisition  work  force, 
the  Services  jointly  developed  a  management  approach  to 
attain  the  desired  level  of  professionalism. 

On  4  February  1988,  the  Honorable  Robert  B.  Costello, 
Under  Secretary  of  Defense  (Acquisition),  directed  that: 

. .  .the  mission  of  DSMC  is  expanded  to  in¬ 
clude  the  entirety  of  acquisition  manage¬ 
ment  as  now  reflected  in  DoDD  5000.1. 

Scope  and  magnitude  of  the  new  mission  (Guide¬ 
lines  p.  7)  represent  the  greatest  challenge  to  DSMC  since 
its  inception  in  1971  by  then  Deputy  Secretary  of  Defense 
David  Packard.  Until  now,  DSMC,  as  the  Defense  Depart¬ 
ment  s  premier  joint  acquisition  management  college,  has 
generally  focused  efforts  on  education,  research  and  publica¬ 
tions  relating  to  program  management  and  systems 
acquisition. 
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The  DSMC  must  now 
broaden  its  horizons  to 
maintain  excellence  in 
education  and  training  in  all 
essential  elements  of  defense 
acquisition  management. 
The  DOD  acquisition  sys¬ 
tem  includes  all  equipment, 
facilities,  and  services 
planned,  designed,  devel¬ 
oped,  acquired,  maintained 
and  disposed  of  within  the  Department.  The  system  extends 
to  establishing  policies  and  practices  governing  acquisitions, 
determining  and  prioritizing  resource  requirements,  direct¬ 
ing  and  controlling  the  process,  contracting,  and  reporting 
to  the  Congress.  More  explicity,  the  Congress  has  asserted 
that  acquisition  includes  all  contracting,  logistics,  program 
management,  systems  engineering,  production  and  manufac¬ 
turing  personnel. 

When  Dr.  Costello  signed  the  letter  dramatically  changing 
the  DSMC  Charter,  it  culminated  a  focused  and  intensive 
2-year  joint  effort  by  the  Services  and  defense  agencies  to 
provide  more  cohesive  and  effective  management  for  their 
ongoing  efforts  to  enhance  the  professionalism  of  our  ac¬ 
quisition  work  force,  the  Honorable  William  H.  Taft  IV, 
Deputy  Secretary  of  Defense,  personally  provided  impetus 
in  August  1985  by  tasking  the  Services  to  conduct  a  com¬ 
prehensive  review  of  actions  needed  to  promote  im¬ 
provements  in  the  management  structure  supporting  our  ac¬ 
quisition  work  force. 
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1.  Program  Manager 

1  a.  Engineer/800 

b.  Program  Manager/340 

2.  Deputy  Frogram  Manager 

2,  a.  Engineer/800 

b.  Program  Manager/340 

3  Business/Financial  Manager 

3.  a.  Program  Analyst/345 
b.  Budget  Analyst/560 

4.  Contracting  Officer 

4.  Contract  Specialist/1102 

5.  Contract  Negotiator 

5.  Contract  Negotiator/ 1 102 

6.  Contract  Specialist 

6.  Contract  Specialist/1102 

7.  Contract  Administrator 

7.  a.  Contract  Administrator/1102 
b.  Contract  Termination 

Specialist/ 1 102 

8.  Procurement  Analyst 

8.  Procurement  Analyst 

9.  Price  Analyst 

9.  Contract  Price/Cost  Analyst/1102 

10.  Quality  Assurance  Specialist 

10.  Quality  Assurance  Specialist/1910 

1 1 .  Procurement  Clerk 

11.  Procurement  Clerk/1106 

12.  Procurement  Assistant 

12.  Procurement  Assistant/1 106 

13.  Purchasing  Series 

13.  Purchasing  Agent/1105 

14.  Industrial  Specialist 

14.  Industrial  Specialist/1105 

15.  Property  Administrator 

15.  a.  Industrial  Property  Management 
Specialist/1103 

b.  Industrial  Property  Clearance 
Specialist/ 1 103 
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The  DSMC  Center  for  Acquisition 
Management  Policy  was  selected  to 
direct  this  joint  effort  under  the  able 
sponsorship  of  Mrs.  Eleanor  Spector, 
Deputy  Assistant  Secretary  of  Defense 
for  Procurement.  The  first  phase  of  the 
tasking,  a  3-month  effort,  was  com¬ 
pleted  when  the  inter-Service/ 
Agency  group  published  a  report  in 
December  1985.  That  Acquisition 
Enhancement  (ACE)  Program  Report: 

— Developed  broader  experience  prere¬ 
quisites  and  increased  education  and 
training  requirements  for  civilian  and 
military  personnel  in  15  job  functions 
(Figure  1). 

—Drafted  new  DOD  directives  to  pro¬ 
mulgate  increased  requirements. 

—  Recommended  establishment  of  a 
DOD  University  of  Acquisition 
Management  (DUAM)  to  provide  the 
management  infrastructure  required  to 
cooperate  activities  of  the  individual 
centers  of  learning  within  DOD. 

—  Recommended  an  in-depth  follow- 
on  study  of  the  DOD  acquisition  train¬ 
ing  base. 
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Significantly,  the  increased  ex¬ 
perience  prerequisites  and  more 
stringent  education  and  training  re¬ 
quirements  were  recommended  by  the 
Services,  refined  by  the  Study  Group, 
and  approved  by  Service  Secretaries. 
All  were  aware  they  could  be  perceived 
to  be  "shooting  themselves  in  the  foot" 
by  increasing  requirements,  knowing 
they  were  not  meeting  existing  ones 
(more  about  that  later).  However,  the 
need  for  enhanced  professionalism  and 
efficiency — not  defensive,  public  rela¬ 
tions  risk  avoidance— prevailed. 

In  short,  the  requirement 
for  this  enhancement  was 
perceived  by  the  Services, 
put  in  place  at  their  request 
and  supported  by  the  Of¬ 
fice  of  the  Secretary  of 
Defense  (OSD),  truly  a 
team  effort. 

The  OSD  immediately  initiated 
staffing  action  necessary  to  promulgate 
the  DOD  directives  and,  in  December 
1986,  published  them.  The  DoDD 
5000.23,  "Systems  Acquisition 
Management  Careers,"  established  in¬ 


creased  experience,  education  and 
training  requirements  for  Program 
Managers,  Deputy  Program  Managers 
and  certain  General  Officers.  For  ex¬ 
ample,  all  Program  Managers  assigned 
after  1  October  1987  must  have  suc¬ 
cessfully  completed  the  Program 
Management  Course  at  DSMC  or  a 
comparable  course  approved  by  the 
Under  Secretary  of  Defense  for  Ac¬ 
quisition.  This  same  requirement  ap¬ 
plies  to  General  Officers  assigned  to 
procurement  commands  or  as  Program 
Managers. 

The  DoDD  5000.48,  "Experience, 
Education  and  Training  Requirements 
for  Personnel  Assigned  to  Acquisi¬ 
tion,"  not  only  increases  experience, 
education  and  training  requirements 
for  designated  civilian  personnel,  but 
applies  equally  to  military  members 
performing  certain  acquisition  job 
functions. 

These  important  actions  were,  of 
course,  designed  to  prepare  our  ac¬ 
quisition  participants  to  perform  more 
effectively.  However,  increased 
demands  for  training  impose  un- 
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precedented  burdens  upon  offerors  of 
this  OSD-mandated  training. 

The  OSD  was  determined  to  quan¬ 
tify  the  impact  of  these  actions,  im¬ 
prove  training  course  content, 
eliminate  unnecessary  duplication 
among  courses,  develop  procedures  to 
fund  reliably  the  training  and  control 
quotas,  and  develop  an  infrastructure 
to  provide  day-to-day  coordination 
and  cohesiveness  to  the  DOD-wide 
education  and  training  effort.  In  May 
1986,  OSD  requested  that  DSMC  con¬ 
duct  the  follow-on  ACE  11  Study  which 
again  was  supported  by  all  Services 
and  the  Defense  Logistics  Agency 
(DLA).  This  7-month  effort  culminated 
in  the  report  to  OSD  in  December  1986 
that  resulted  in  the  change  to  the 
DSMC  mission. 

The  study  found  that  individual  Ser¬ 
vices  and  Agencies  had  applied  signifi¬ 
cant  resources,  including  senior 
management  attention,  to  support 
ongoing  OSD  efforts  to  enhance  the 
professionalism  and  efficiency  of  the 
DOD  acquisition  work  force. 
However,  these  individual  efforts,  con¬ 
ducted  within  the  existing  management 
structure,  proved  inadequate  to  pro¬ 
vide  OSD-mandated  training  to  all 
people  requiring  it. 

A  General  Accounting  Office  audit 
in  1984  showed  no  more  than  40  per¬ 


il  short,  the 
requirement  for  this 
enhancement  was 
perceived  by  the 
Services,  put  in  place 
at  their  request  and 
supported  bv  the 
Office  of  the  Secretary 
of  Defense  (OSD), 
trulv  a  team  effort. 


cent  of  required  training  being 
provided  to  personnel  needing  it.  In 
August  1985,  Mr.  Taft  directed  Ser¬ 
vices  and  Agencies  to  support  training 
for  a  minimum  of  85  percent  of  their 
mandatory  acquisition  training  re¬ 
quirements  each  year.  The  ACE  II 


Study  confirmed  the  training  status  by 
analyzing  data  generated  by  the  Ser¬ 
vices. 

Simply  stated,  the  study  asserted  it 
was  not  enough  to  direct  attaining  the 
training  objective  without  providing  a 
more  effective  management  mecha¬ 
nism.  Further,  the  study  found  OSD 
was  relying,  and  properly,  upon  the 
time-honored  philosophy  of  centra¬ 
lized  policy  direction  and  decentral¬ 
ized  execution;  but,  the  problem  was, 
and  is,  too  broad  to  be  resolved  by 
Service/ Agency  independent  actions 
no  matter  how  well  conceived  and  ex¬ 
ecuted.  More  coordination  among  the 
services  was  required. 

The  ACE  II  Study  Group  found  ap¬ 
proximately  56,000  civilian  and 
military  men  and  women  in  the  ac¬ 
quisition  work  force  dedicated  to  con¬ 
tracting,  quality  assurance  and  pro¬ 
gram  management  activities  (Figure  2). 
It  determined  that  the  training  backlog 
of  the  work  force  measured  against  the 
stringent  training  requirements  con¬ 
tained  in  the  aforementioned  directives 
was  awesome.  It  would  require  ap¬ 
proximately  2,000,000  student  "per¬ 
son-days"  to  overcome  the  backlog. 
The  study  group  determined  this  was 
within  the  capability  of  our  education 
and  training  base  if— and  only  if— all 
available  resources  were  applied  in  a 
coordinated  fashion. 


Ti  .  i.J>  Vi  POSITION  OF  THE  WORK  FORCE  TOTALS  BT 
/  \  Jry  At.-EIMCY  AST)  JOB  SERIES  (MILITARY  AND  CIVILIAN) 

OTHER  DOD 

Job  Function/Series  ARMY  NAVY  MARINES  AIR  FORCE  DLA  AGENCIES  TOTAl 


Contracting 
Procurement  Clerk 
Purchasing  Series 
•Program  Manager  (Major) 
Program  Manager  (Non-major) 
Deputy  Program  Manager 
Business/Financial  Manager 
Quality  Assurance  Specialist 
Property  Administrator 
Industrial  Specialist 

Major  programs  as  defined 

in  DOD  Dir  5000  1 


ARMY 

NAVY 

MARINES 

AIR  FORCE 

DLA 

AGENCIES 

TOTAL 

6.551 

4,671 

221 

9,712 

4,967 

77 

26,199 

2,077 

1.791 

68 

1,512 

2,190 

16 

7,654 

1,101 

1,630 

108 

425 

69 

6 

3.339 

20 

38 

3 

35 

0 

5 

101 

73 

113 

3 

250 

0 

13 

452 

93 

158 

7 

285 

0 

0 

543 

0 

78 

0 

0 

0 

65 

143 

2.757 

2.777 

21 

1,495 

6.742 

4 

13,796 

162 

161 

2 

232 

374 

i 

932 

593 

676 

8 

2 18 

1.125 

5 

2,625 

13,427 

12,093 

441 

14.164 

15,467 

192 

55,784 
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The  study  group  recommended  that  several 
actions  be  initiated  immediately  to  reduce  this  backlog. 


Action  1. 


Action 


Action  4. 


Grant  waivers  where 
appropriate.  Several 
courses  with  significant 
backlogs  have  perfor¬ 
mance  testing,  and 
waivers  could  be 
granted  based  upon 
these  tests.  Waivers  also 
may  be  granted  for  ap¬ 
propriate  experience 
and  other  education  and 
training. 


Redistribute  training 
loads  among  equivalent 
courses  within  the  DOD 
training  base. 


Action  3. 


Identify  existing  courses 
outside  the  DOD  train¬ 
ing  base  that  may  be 
equivalent.  Courses  or 
combinations  of  courses 
that  could  be  used  in 
place  of  a  training  base 
course  would  increase 
capacity  and  also  reduce 
backlog  figures. 


Increase  current  capaci¬ 
ty  without  using  addi¬ 
tional  resources.  Mirror 
adjustments  to  class 
sizes  could  increase 
capacity  by  perhaps  10 
percent. 
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Action  5. 


Rely  on  existing  cor¬ 
respondence  modes  to 
satisfy  required  capac¬ 
ity. 


Action  6. 


Develop  additional  cor¬ 
respondence  modes 
where  prudent.  This 
mode  is  ideal  for  courses 
whose  objectives  are 
primarily  knowledge 
level. 


Action  7. 


Offer  additional  classes 
per  year.  Increasing  the 
number  of  class  offer¬ 
ings  each  year  will  in¬ 
crease  capacity  without 
incurring  development 
costs. 


Action  8. 


Develop  exportable 
training  courses.  This 
includes  video  tapes, 
video  discs,  satellite 
communications,  and 
computer-based  medias. 


Action  9. 


Use  additional  contract 
courses  to  augment 
training  base.  This  pro¬ 
vides  an  immediate 
short-term  means  to  ad¬ 
dress  training  capacity 
deficiencies. 


The  keystone  recommendation  of 
the  study  was  to  identify  a  central  en¬ 
tity  to  provide  full-time  day-to-day 
direction  to  the  entire  effort;  not 
because  it  offers  a  panacea  to  the 
education  and  training  problem  con¬ 
fronting  DOD,  but  because  it  offers  the 
best  managerial  approach  the  study 
group  could  develop  to  cope  with  the 
problem  over  the  long  term.  The  study 
group  was  convinced  that  short-term 
ad  hoc  personality  driven  "solutions" 
had  not  worked  well  enough;  nor  was 
the  status  quo  acceptable. 


Coordinating  and,  to  a  degree, 
directing  implementation  actions  are 
part  of  the  expanded  mission  of 
DSMC.  The  Commandant  will  exer¬ 
cise  authority  across  the  spectrum  of 
the  DOD  education  and  training  base 
only  in  curriculum  areas  relevant  to 
mandatory  acquisition  training  and 
education  and  will  be  responsive  to  the 
Under  Secretary  of  Defense  for  Ac¬ 
quisition.  Any  action  to  delete  or 
develop  such  courses  will  be  taken 
only  after  appropriate  consultation 
with  appropriate  functional  experts 
like  the  Defense  Contracting  and  Ac¬ 
quisition  Career  Management  Board 
(DCACMB). 


These  actions  were  not  enough.  The 
study  group  determined  additional  and 
concurrent  efforts  were  required  to:  1) 
enhance  the  learning  value  of  man¬ 
datory  courses  by  making  them  more 
competency-based;  2)  restructure  them 
to  reduce  variety  and  number;  and  3) 
establish  fewer  mandatory  courses  per 
experience  level  for  each  job  function 
series  and  require  attendance  at  those 
courses  early  in  each  individual's 
eligibility  period.  The  study  group  felt 
this  dual  and  concurrent  approach 
would,  if  properly  coordinated,  over¬ 
come  our  training  backlog  within  ap¬ 
proximately  3  years  without  applica¬ 
tion  of  significant  amounts  of  un- 
progiammed  funds.  The  operative 
words  are  "if  properly  coordinated." 


Responsibility  for  teaching  man¬ 
datory  courses  will  remain  with  ex¬ 
isting  learning  centers  (Figure  3)  which 
will  develop,  revise,  or  delete  the 
courses.  Funding  for  student  travel  and 
per  diem  for  mandatory  courses  will  be 
provided  by  DSMC  starting  in  fiscal 
year  1990.  In  this  regard, the  DSMC 
will  be  an  honest  broker  to  provide  the 
student  seats  required  to  meet  Service 
requirements.  Costs  will  be  based  on 
annual  mandatory  requirements  sub¬ 
mitted  by  the  Services  and  DOD  agen¬ 
cies.  The  DSMC  will  provide  Services 
and  DOD  agencies  a  block  of  quotas 
annually  to  administer,  based  on  their 
requirements  for  mandatory  courses. 
Predominately  Service  unique,  non¬ 
mandatory  courses  will  continue  to  be 
taught  and  funded  by  Service  schools. 


Since  March  1987,  the  Services  and 
Defense  Agencies  have  been  an¬ 
ticipating  this  mission  change  and  have 
worked  closely  with  DSMC.  Their  ac¬ 
tions  were  in  response  to  a  March  16, 
1987,  letter  from  Dr.  Costello,  in 
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SPONSORING 

SCHOOL 


COURSE 

IDENTIFIER 


COURSE 

TITLE 


AFIT 

PPM  057  (J T) 

Contract  Administration  (Executive)  * 

PPM  151  (JT) 

Industrial  Property  Administration 

PPM  153  (JT) 

Production  Management  1 

PPM  300  (JT) 

Advanced  Property  Administration*  * 

PPM  302  (JT) 

Government  Contract  Law 

PPM  304  (JT) 

Advanced  Contract  Administration*  * 

PPM  305  (JT) 

Production  Management  II” 

QMT  170  (JT) 

Principles  of  Contract  Pricing*  * 

QMT  345  (JT) 

Quantitative  Techniques  for  Cost 
&  Price  Analysis 

QMT  540  (JT) 

Advanced  Contract  Pricing** 

ALMC 

8D-4320  (JT) 

Management  of  Oefense  Acquisition 

Contracts  (Basic)'  ’ 

8D-F12  (JT) 

Management  of  Defense  Acquisition 

Contracts  (Advanced)  - ' 

ALMC-B5  (JT) 

Management  of  Defense  Acquisition 

Contracts  (Executive)* 

ALMC-B3  (JT) 

Defense  Small  Purchase  (Basic) 

j 

ALMC-B4  (JT) 

Defense  Small  Purchase  (Advanced)* 

| 

ALMC-TY  (JT) 

Defense  Contract  Property  Disposition 

] 

ALMC-QC  (JT) 

Quality  Assurance  Management  r  • 

ALMC-QD  (JT) 

Quality  Assurance  Management  II” 

j  NAVY 

ER 

Defense  Acquisition  and  Contracting 

Executive  Seminar 

.  AMETC 

1 

TBD 

Defense  Quality  Assurance- 

j  OSMC 

DSMC-4 

Program  Management  Course 

1 

1 

! 

DSMC-31 

Major  Systems  Acquisition  for 

Contracting  Personnel' 

! 

’Course  to 

be  developed 

1  '  'Existing  course  to  be  reviewed,  as  appropriate,  to  reflect  course  consolidations. 

1 

which,  he  asked  the  DSMC  Comman- 

and  travel  funding  as  recommended  by 

dant  "to  serve  as  my  action  agent,  with 

the  ACE  II  Repott. 

support  from  the  Services  and  DOD 
agencies,  to  accomplish  the  following 
tasks  as  quickly  as  possible. 


— Develop  and  promulgate  course 
equivalency  procedures  and  stan¬ 
dards." 


—  Establish  a  Curriculum  Advisory 
Council  as  recommended  by  the  ACE 
II  Report. 

—Task  learning  centers  to  develop 
competency  based  curricula  and 
courses  as  recommended  by  the  ACE 
II  Report  and  in  consultation  with  the 
responsible  functional  groups  (e.g., 
Defense  Contract/ Acquisition  Career 
Management  Board). 

—  Initiate  actions  to  increase  student 
output  of  selected  courses. 

Initiate  actions  to  streamline  man¬ 
datory  training  waiver  procedures 

— Initiate  actions  to  formalize  per  diem 


These  actions  are  well  under  way. 
Near-term  activities  will  continue  to 
focus  upon  completion  of  the  Costello 
tasking;  this  requirement  is  immediate, 
compelling  and  formidable.  The 
longer-term  challenge  of  extrapolating 
the  successful  ACE  Program  model  to 
include  the  remainder  of  the  acquisi¬ 
tion  work  force  will  require  the  active 
participation,  dedication  and  coopera¬ 
tion  of  the  Services,  Agencies  and  ap¬ 
propriate  DOD  learning  centers.  Cer¬ 
tainly,  DSMC  has  a  role  to  play  in  this 
important  endeavor.  Equally  certain, 
however,  is  the  tact  that  it  cannot  "go 
it  alone." 


GUIDELINES 


DEFENSE  SYSTEMS 
MANAGEMENT 
COLLEGE 


EXPANDED  MISSION 


It  is  DoD  policy  to  prepare  and  assign 
fully  qualified  individuals  to  positions 
in  support  of  defense  acquisition.  Ex¬ 
isting  documents  establish  and  imple¬ 
ment  training,  education,  and  ex¬ 
perience  requirements  for  some  ac¬ 
quisition  personnel.  To  facilitate  fulfill¬ 
ment  of  this  training  and  education  re¬ 
quirement,  and  provide  for  improved 
education  opportunities  for  the  entire 
acquisition  workforce,  the  mission  of 
the  Defense  Systems  Management  Col¬ 
lege  (DSMC)  is  expanded  to  include 
the  entirety  of  acquisition  manage¬ 
ment. 

To  accomplish  this  mission,  the  DSMC 
will  be  the  action  agent  for  the  USD(A) 
with  the  support  of  the  Services  to: 
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a.  Provide  certification  oi  DoD 
and  non-DoD  education  and  training 
centers  tor  course  equivalency. 

b.  Provide  full-time  oversight  for 
DoD  acquisition  training  and  educa¬ 
tion  in  coordination  with  the  ap¬ 
propriate  functional  board. 

c.  Avoid  unnecessary  duplication 
in  curricula. 

d.  Develop  and  promote  current 
and  effective  methods  of  acquisition- 
related  training  and  education. 

e.  Ensure  the  conduct  of  high 
quality  mandatory  training  and  educa¬ 
tion  courses  of  study  by  DoD  and  non- 
DoD  sources  that  shall  prepare  selected 
military  officers  and  civilian  personnel 
for  assignments  in  acquisition  career 
fields. 

f.  Manage  the  annual  quota  alloca¬ 
tion  process  related  to  the  courses 
described  in  DoD  Directives  5000.23, 
5000.48,  5010.16,  and  DoD  Manuals 
1430. 10-M-l  and  1430.10-M-2  and  as 
directed  by  the  USD(A)  to  encourage 
the  most  cost  effective  use  of  DoD  and 
non-DoD  training  resources  while 
maintaining  an  adequate  level  of  ac¬ 
quisition  training  expertise  and 
facilities  within  DoD  to  accomplish  the 
mission. 

g.  Budget  for  resources  associated 
witn  the  quota  relocation  process,  in¬ 
cluding  all  mandatory  training  and 
education. 

h.  Develop  appropriate  experi¬ 
ence.  education,  and  training  stan¬ 
dards  that  may  be  used  in  place  of 
mandatory  acquisition  courses. 

i.  Develop  appropriate  alternative 
training  and  education  programs  to  in¬ 
clude  non-DoD  and  contract  activities. 

j.  Promote  and  conduct  research 
and  provide  information  related  to  ac¬ 
quisition  management  training  and 
education. 

k.  Recommend  to  the  USD(A)  ad¬ 
ditions  or  deletions  to  the  mandatory 
courses  in  DoD  Directives  5000.23  and 
5000.48  after  coordination  with  ap- 
pt  ipriate  functional  b^a’xis. 

l.  Provide  oversight,  review,  and 
guidance  in  course  development  ac¬ 
tivities  to  maintain  course  quality. 
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Functional  Boards,  such  as  the  Defense 
Contracting  and  Acquisition  Career 
Management  Board  (DCACMB),  the 
Quality  Assurance  Council  (QA 
Council)  and  the  Defense  Management 
Education  and  Training  Board 
(DMETB),  shall  provide  advice  to  the 
DSMC  regarding  the  requirements  of 
education  and  training  of  functional 
personnel  under  the  cognizance  of  the 
respective  boards. 

The  Commandant,  DSMC  shall  be 
responsible  for  executing  the  mission 
in  accordance  with  the  policy  guidance 
provided  by  and  approved  by  the 
USD(A).  The  Commandant  shall 
review  the  operation  and  ac¬ 
complishments  and  report  findings  to 
the  USD(A)  annually. 

The  Secretaries  of  the  Military  Depart¬ 
ments  and  Directors  of  the  Concerned 
Defense  Agencies  (or  Their  Designees). 
shall: 

a.  Ensure  that  the  DoD  Component 
schools  and  training  centers  develop 
effective  working  relationships  be¬ 
tween  the  DSMC  and  the  schools. 

b.  Submit  to  the  DSMC  the  annual 
requirements  and  5-year  projections 
for  each  mandatory  course  to  meet  the 
mandatory  education  and  training 
requirements. 

c.  Maintain  entry,  no-show,  grad¬ 
uate,  and  other  course  data  and  pro¬ 
vide  same  to  the  DSMC  upon  request. 

d.  Advise  the  DSMC  of  manpower 
authorizations  used  to  staff  the  Service 
Learning  Centers  for  the  DoD  man¬ 
datory  courses. 

e.  Submit  semiannual  cost  data  for 
student  and  faculty  travel  and  per 
diem,  operations  and  maintenance 
(O&M)  support  costs,  and  curriculum 
development,  maintenance  and  revi¬ 
sion  costs. 

The  Secretary  of  the  Army,  or  de¬ 
signee,  shall: 

a.  Provide  support  services  and 
maintain  facilities  and  equipment 
essential  to  the  functioning  of  the 
DSMC  at  Fort  Belvoir  and  ensure  that 
administrative  and  resource  support  is 
timely,  adequate,  and  supportive  of 
the  DSMC's  mission. 

b.  Include  the  DSMC's  annual 
budget  in  the  Department  of  the 


Army  s  overall  budget  and  financial 
plan  and  Program  Objectives 
Memorandum  (POM)  submission  The 
USD(A)  will  be  consulted  prior  to  in¬ 
corporation  within  Army-level 
documents  of  any  proposed  down¬ 
ward  adjustments  in  the  DSMC  s 
budget,  POM  submission,  manpower, 
or  facilities. 

The  Assistant  Secretary  of  Defense 
(Force  Management  and  Personnel) 
shall: 

a.  Through  the  Training  and  Per¬ 
formance  Data  Center  develop  and 
maintain  an  education  and  training  in¬ 
formation  data  base  to  support  ac¬ 
quisition  requirements,  including  those 
for  course  files,  master  course 
schedule,  and  job  aids. 

b.  Through  the  Defense  Manpower 
Data  Center  develop  and  maintain  a 
functional  and  training  related  data 
base  to  track  the  training  status  of  ac¬ 
quisition  personnel. 

Programming,  Budgeting,  and  Finan¬ 
cing 

1 .  The  DSMC  shall  separately  identify 
and  budget  for  its  resources  to  include 
funds  for  student  and  faculty  travel 
and  per  diem.  Operation  and  Main¬ 
tenance  (O&M)  student  support  costs, 
and  curriculum  development  and  revi¬ 
sion  costs  for  the  mandatory  courses. 
The  DSMC’s  program  and  budget  plan 
will  be  submitted  to  the  Army,  its  ex¬ 
ecutive  agent. 

2.  If  additional  instructional  resources 
and  supporting  facilities  are  required 
over  and  above  that  allocated  for  the 
mandatory  courses,  requirements  shall 
be  forwarded  to  the  DSMC  with  a 
detailed  justification  plan  for  them. 
The  DSMC  shall  make  adjustments 
where  possible  in  the  DoD  acquisition 
training  base  to  eliminate  the  need  for 
the  additional  resources.  If  adjustments 
cannot  be  made  and  additional  funding 
is  required,  the  request  shall  be  for¬ 
warded  to  the  USD(A)  for  applicable 
action  and  direction. 


Brigadier  General  Hirscb  is  the  Chair¬ 
man,  Center  for  Acquisition  Management 
Policy,  the  Defense  Systems  Alanaptemcnt 
Collette. 
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Dr.  Alan  W.  Beck ,  CPCM 


t  we  generally  write 

good  contracts,  which 

clearly  and  fairly  state  the 

w\ 

responsibilities  of  the  seller 
;n  performing  for  the  buyer, 
why  do  we  have  changes? 
Changes  are  needed  when¬ 

r 

tr 

ii 

1! 

;i 

ever  the  original  contract 
agreement  is  no  longer  ade¬ 
quate  to  document  what 
needs  to  be  done.  Control¬ 

ling  contract  changes  is  a 

management  challenge  both 

-seri»-  — 

tor  contractors  performing 
the  contract  and  for  gov-  _ 

ernment  managers  who 

want  the  contractor  to  do  what  should  (in  whose  opinion?) 
be  done.  While  relatively  simple  or  technologically  stable 
goods  or  services  are  procured  in  contracts  which  may  have 
no  changes,  contracts  for  complex  items  developed  in  an 
arena  of  technological  uncertainty  may  require  thousands 
of  changes. 

The  process  for  making  formal  written  changes  to  the  con¬ 
tractual  agreement  is  one  of  getting  and  documenting  the 
revised  contract  agreement.  The  basic  contract  may  have 
terms  which  anticipate  and  establish  ground  rules  for  cer¬ 
tain  categories  of  change,  such  as  the  Government  Furnished 
Property  (GFP)  clause,  the  Changes  clause,  or  some  specially 
tailored  clause  language  in  the  Special  Contract  Re¬ 
quirements  section  of  the  contract.1  If  your  contract  lacks 
special  language  covering  a  particular  change  situation,  the 
basic  process  is  to  seek  agreement  of  what  is  to  be  done  by 
the  contractor,  and  to  establish  the  appropriate  price  and 
delivery  schedule. 
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To  look  at  how  we  control 
contract  changes,  let's  first 
look  at  the  formal  terms  and 
process  of  making  contract 
changes.  Then,  with  the 
vocabulary  and  process 
knowledge  as  a  foundation, 
we  can  look  at  how  to  deal 
with  the  various  factors 
causing  change.  With  pro¬ 
cess  understanding  and  in¬ 
sight  into  causes,  we  can 
then  discuss  actions  to  im¬ 
prove  change  management. 

Definitized  Or  Undefinitized 

There  are  two  major  choices  of  how  to  put  a  change  on 
a  contract.  The  preferred  way  is  to  get  full  and  final 
negotiated  agreement  on  work,  cost  and  schedule  with  both 
parties  signing  the  change.  When  both  parties  sign  the 
change  it  is  called  a  supplemental  agreement.  The  less  pre¬ 
ferred,  but  sometimes  appropriate  way  if  you  can’t  wait  for 
?  fully  priced  definitized  agreement,  is  to  have  an  "undefini¬ 
tized"  change. 

Undefinitized  changes  are  less  preferred  because  the  price 
remains  to  be  negotiated.  While  it  is  often  undesirable  to 
have  someone  like  your  home  builder)  working  with  a 
"blank  check,"  sometimes  it  makes  sense  to  have  work 
started  before  firm  prices  are  established;  i.e.,  when  I  tell 
the  gas  station  "my  car  is  running  rough,  please  fix  it."  To 
protect  against  the  unlimited  potential  "blank  check"  cost, 
contracting  officers  normally  obtain  a  "not-to-exceed"  price 
agreement  to  put  a  cap  on  the  yet-to-be-negotiated  price  for 
the  change  (such  as  telling  the  gas  station,  "Fix  it  if  it’s  not 
more  than  $200)." 
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I  Undefinitized  Change  Order 

Change  Orders  are  the  most  com¬ 
monly  thought  ot  type  ot  undefinitized 
contract  change.  Because  complex 
work  is  often  likely  to  require  change, 
the  Federal  Acquisition  Regulation 
'FAR'  has  standard  Changes  clauses 
tor  government  contracts.-  The 
Changes  clause  allows  contracting  of¬ 
ficers  to  unilaterally  direct  changes  in 
the  specification  shipping  or  packing. 
H«."\  This  means  that  the  government  may 
direct  a  change  in  ichat  it  wants 
technical  requirements,  not  quantity), 
where  it  wants  it  delivered,  and  hou' 
the  item  should  be  packed.  Since  the 
change  may  well  impact  the  costs  and 
schedule  of  the  contract,  the  clause 
allows  for  the  contractor  to  request  an 
equitable  adjustment  in  the  contract 
cost  and  or  schedule. 

1.  Technical  requirements.,  funding 
tind  management  approval.  How  does 
the  change  order  process  work? 
Basically,  the  contracting  officer  needs 
technical  detail  of  what  is  to  be 
changed  in  the  requirements,  funding 
to  covei  anticipated  costs,  and 
authority  to  issue  the  change  order. 
The  greatest  ot  these  hurdles  may  well 
be  getting  authority  to  issue  the  change 
order.  Contractual  authority  under  the 
FAR  changes  clause  is  not  the 
difficulty:  the  issue  is  more  often  a 
management  concern  for  limiting 
undefinitized  work.  Many  organiza¬ 
tions  have  additional  review  pro¬ 
cedures  requiring  special  justification 
and  approval  before  their  contracting 
officers  are  allowed  to  issue 
undefinitized  changes.  Even  the  Con¬ 
gress  has  gotten  into  management  of 
undetinitized  contractual  actions 
through  legislation  limiting  overall 
percentages  cm  new  awards.  This  trend 
will  not  make  it  easier  for  contracting 
officers  to  issue  undefinitized  actions 
when  appropriate. 

2.  Not-to-exceed  price  agreement. 
The  contracting  officer  will  want  the 
contractor  to  agree  to  a  not-to-exceed 
price  to  limit  the  government's  poten¬ 
tial  cost  exposure  for  the  change. 
When  there  are  uncertainities  in  the 
pricing,  a  rational  contractor  will  in¬ 
crease  the  not-to-exceed  price  slightly 
over  best  guess  estimates.  When  the 
contractor  is  rushed  to  provide  a  price. 
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without  time  to  talk  to  subcontractors 
or  to  do  detailed  cost  estimating,  the 
word  may  be  it  you  want  it  bad,  you 
get  it  bad.  Where  unusual  cir¬ 
cumstances  might  dictate  contractual 
direction  without  waiting  to  agree  on 
a  not-to-exceed  price,  it  is  theoretical¬ 
ly  possible  to  do  without  one,  but  this 
is  rare  and  not  good  practice. 

3.  Issue  the  change  order.  Given 
management  approval,  money,  re¬ 
quirements,  and  an  agreed  not-to- 
exceed  price,  the  easy  part  is  to  make 
the  contract  change.  It  may  be  as  a 
simple  as  a  one-page  contract  change 
form  with  a  fund  citation  and  remarks 
block  entry  which  simply  says 
"Engineering  Change  Proposal  336  is 
incorporated,  pursuant  to  the  changes 
clause,  at  not-to-exceed  5800,000.''  The 
contracting  officer  may  need  to  get  in¬ 
ternal  legal  or  other  review,  and  may 
want  to  include  by  reference  the  con¬ 
tractor's  letter  offer  of  the  not-to- 
exceed  price,  or  may  ask  the  contrac¬ 
tor  to  also  sign  the  undefinitized 
change  to  formally  record  agreement 
to  the  not-to-exceed  price.  Once  the 
contracting  officer  gets  the  document 
approved  and  signed,  it  is  mailed,  or 
handed,  to  the  contractor  with  copies 
sent  to  the  finance  office  to  record  the 
obligation,  to  the  payment  office,  and 
to  others  on  the  contract  distribution 
list. 

4.  Definitize  the  undefinitized 
change.  The  undefinitized  change 
order  is,  in  a  sense,  a  temporary 
change.  It  requires  subsequent  agree¬ 
ment  on  the  exact  changes  to  the  con¬ 
tract  pricing.  This  agreement  to 
definitize  the  change  is  done  contrac¬ 
tually  in  a  Supplemental  Agreement  — 
the  same  way  most  changes  are  done 
if  urgency  doesn't  justify  starting  the 
contractor  first  with  a  change  order. 


Supplemental 


II.  Definitized 
Agreement 

The  preferred  way  to  change  con¬ 
tract  requirements  is  with  a  definitized 
supplemental  agreement,  which  both 
parties  sign,  documenting  full  agree¬ 
ment  on  what  is  changed  and  the  price 
adjustments,  if  any,  resulting  from  the 
change.  This  is  the  way  the  majority 
of  changes  are  incorporated  into  con¬ 
tracts.  Undefinitized  change  orders  are 
rare,  but  sometimes  justified  because 
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the  process  of  issuing  a  supplemental 
agreement  can  take  months.  Let  s  look 
at  the  key  steps  to  see  what  is  done  and 
why  it  sometimes  takes  6  months  or 
more  to  complete  the  action. 

1 .  The  contractor  prepares  and 
submits  a  change  proposal  This  action 
may  be  contractor  initiated  or  re¬ 
quested  by  the  contracting  officer. 
There  may  be  considerable  preliminary 
work  by  either  or  both  parties  in  plan¬ 
ning  what  needs  are  changing,  propos¬ 
ing  technical  changes  (possibly  formal 
Engineering  Change  Proposals)  or  even 
in  preliminary  cost  estimating  (such  as 
needed  to  agree  on  a  not-to-exceed 
price. )  That  activity  could  take  weeks 
or  months.  The  contractor's  proposal 
preparation  time  depends  on  the  com¬ 
plexity  of  the  pricing;  where  there  is 
extensive  subcontracting,  the  pricing 
may  be  more  accurate  if  the  contrac¬ 
tors  have  time  to  get  detailed  price 
quotes  from  their  subs  rather  than 
back-of-the-envelope  guesstimates. 
Even  a  simple  change  may  take  a 
month  for  the  contractor  to  get  all  the 
prices  estimated,  summed  and  ap¬ 
proved  as  a  proposal. 

2.  The  government  evaluates  and 
audits  the  proposal.  To  determine  the 
right  terms,  technical  effort  and  price 
for  the  change  requires  careful  pro¬ 
posal  review  and  cost  analysis.  This 
review  typically  takes  two  major 
actions— technical  evaluation  and 
audit.  The  technical  evaluation  reviews 
the  proposed  materials,  labor  and 
work  requirements.  The  materials 
review  may  cover  technical  charac¬ 
teristics,  scrap  estimates,  and  quan¬ 
tities  required.  The  labor  review  in¬ 
cludes  both  levels  of  each  skill  required 
and  the  hours  for  each  level.  The  work 
requirements  review  would  include 
overall  evaluation  on  any  changes  in 
the  statement  of  work  or  technical 
specifications.  The  audit  (for  changes 
more  than  $100,000)  involves  Defense 
Contract  Audit  Agency  (DCAA)  re¬ 
view  of  three  major  areas:  the  contrac¬ 
tor's  labor  costs  for  each  proposed 
level  of  skill,  the  indirect  "overhead" 
cost  rates  for  labor,  material,  or 
dollars,  and  the  costs  for  proposed 
materials.  The  DCAA  audit  typically 
takes  6-8  weeks,  with  additional  time 
for  inputs  by  the  contract  administra¬ 
tion  team.  Sometimes,  a  few  days  can 
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be  saved  by  good  coordination  with 
the  in-plant  contract  administration 
team  to  ensure  that  DCAA  gets  the 
proposal  promptly,  and  that  the  in- 
plant  team  gets  timely  opportunity  for 
Held  pricing  support  input  on  the 
proposal. 

3.  The  government  and  contractor 
prepare  for  negotiations.  Negotiation 
preparation  involves  identification  of 
any  issues  to  be  resolved  and  detailed 
cost  analysis  to  estimate  the  ap¬ 
propriate  pricing  for  the  effort.  The 
contracting  officer  or  a  specialist  will 

crunch  '  the  numbers  for  each  portion 
of  the  price.  The  recommended  range 
of  labor  hours  and  skills  from  the 
technical  evaluation  will  be  multiplied 
by  the  hourly  rates  from  the  audit 
report  for  each  category  of  labor. 
These  costs,  and  any  other  direct  costs, 
form  the  basis  for  computing  indirect 
costs  using  the  audit  recommendations 
on  overhead  costs.  Material  costs  are 
estimated,  with  material  overhead  pro¬ 
jections  based  on  audit  report  input. 
Other  indirect  costs  such  as  General 
and  Administrative  or  Fringe  costs  are 
estimated  using  the  audit/field  pricing 
support  recommended  rates.  Profit  is 
estimated  using  the  guidelines  of  the 
FAR  plus  supplements.  Fact  finding 
discussions  may  be  required  to  provide 
a  basis  for  negotiation.  Negotiation 
strategy  for  the  entire  package,  in¬ 
cluding  any  changes  to  the  pricing 
structure  or  contract  incentives,  may 
then  be  reviewed  for  pre-negotiation 
clearance  according  to  local  procedure. 
This  pricing  and  negotiation  prepara¬ 
tion  process  may  take  a  few  days  or 
a  couple  of  weeks. 

4.  Negotiations.  This  is  the  art  of 
obtaining  agreement  on  what  is  to  be 
done  and  on  what  terms.  How  long  it 
takes  depends  on  the  complexity  of  the 
change  and  the  participants'  inter¬ 
action. 

5.  The  contract  language  is  drafted 
and  reviewed.  Controversial  new 
language  will  probably  be  worked  out 
at  the  negotiation  table,  but  after 
negotiation  the  exact  wording  and  for¬ 
mat  of  the  planned  change  has  to  be 
drafted.  Depending  on  dollar  value 
and  management  interest,  the  pro¬ 
posed  change  package  will  then  be  sub¬ 
let  to  review  by  legal  officials  and  a 
special  contract  review  activity  accord- 
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ing  to  local  procedure.  Hopefully, 
none  of  these  reviews  will  require 
reproposal  and  renegotiation. 

ft.  The  contractor  reviews  and  signs. 
The  proposed  contract  modification  is 
mailed  to  the  contractor  for  signature. 
The  contractor  may  require  internal 
reviews  before  signing  the  proposed 
change.  This  could  take  a  few  hours  if 
the  change  was  relatively  simple,  or 
weeks  it  the  change  was  serially  coor¬ 
dinated  from  organization  to  organiza¬ 
tion  with  no  special  priority. 

7.  The  contracting  officer  reviews 
and  signs.  On  receipt  of  the  contractor- 
signed  proposed  modification,  the  con¬ 
tracting  officer  will  make  a  final  review 
and  may  have  requirements  for  other 
internal  reviews  or  clearance  before 
signature.  The  Army  and  Navy  have 
a  procedure  called  Business  Clearance 
to  provide  signature  approval  authori¬ 
ty.  The  Air  Force  requires  counter 
signature  by  higher-level  authority  if 
the  dollar  value  is  above  certain 
thresholds.  This  step  may  take  several 
days,  particularly  if  someone  in  head¬ 
quarters  wants  to  ask  more  questions. 

8.  Reproduction  and  mailing. 
Reproduction  of  copies  for  the  contract 
mailing  list  may  take  several  more 
days.  The  supplemental  agreement 
does  not  become  effective  on 
signature,  but  when  it  is  distributed 
( "mailing  date")  to  the  contractor  and 
to  finance  to  record  the  obligation. 

III.  Other  Formal  Changes:  PIO 
and  ADMIN 

In  addition  to  the  change  order  and 
the  supplemental  agreement,  there  are 
other  areas  in  which  the  PCO  can  issue 
changes.  Administrative  (no  cost) 
changes  may  be  issued  by  the  contract¬ 
ing  officer  unilaterally  to  make  minor 
(non-controversial)  changes  such  as 
changing  the  name  of  a  government 
representative,  or  obligating  additional 
funding  for  an  incrementally  funded 
contract.  A  Provisioned  Item  Order 
(PIO)  is  used  to  order  spare  parts 
through  the  provisioning  process;  these 
orders  may  be  added  unilaterally  to  a 
production  contract  to  permit  timely 
(concurrent)  manufacture  of  the  initial 
spare  parts  while  the  production  parts 
are  being  made.  The  PIOs  are  an  ad¬ 
ministratively  convenient  way  to  order 
spares.  They  may  cite  estimated  prices 


(undefinitized)  with  the  ACO 
negotiating  final  prices.  Prompt  order¬ 
ing  using  undefinitized  PIOs  to  allow 
concurrent  production  with  end-items 
may  provide  schedule  and  cost  benefits 
which  outweigh  the  usual  government 
preference  to  wait  for  negotiation  of 
definitized  prices  before  ordering. 

IV.  Managing  Change 

The  manager's  challenge  is  how  to 
limit  or  eliminate  non-essential  changes 
while  seeing  that  necessary  changes  are 
made  in  a  timely  manner,  within  the 
constraints  of  law  and  policy.  Fre¬ 
quently,  changes  are  needed  when  (or 
before)  they  are  suggested,  so  the  users 
or  requiring  activities  may  want  the 
change  made  as  soon  as  possible.  This 
increases  pressure  on  the  manager  for 
rapid  approval  technically,  for  finding 
existing  money  rather  than  waiting  for 
justification  in  a  budget  submission, 
and  for  wanting  the  contractor  to  start 
work  quickly  rather  than  wait  for  a 
definitized  change.  Managers  are  paid 
for  making  things  happen;  however, 
the  system  inserts  pragmatic  checks  to 
be  sure  we  don't  make  mistakes.  The 
preference  for  getting  a  definitized  fair 
price  before  work  starts  is  often 
frustrating  to  contractors  and  govern¬ 
ment  managers  who  want  changes  to 
be  made  quickly. 

Undefinitized  work  authorization 
may  make  good  sense  when  the  costs 
of  delay  in  implementing  change  are 
weighed  against  the  benefits  of  earlier 
change.  Managers  have  to  decide  when 
it  makes  good  business  sense  to  order 
changes  without  firm  negotiated 
prices.  As  senior  managers,  and  now 
the  Congress,  have  perceived  problems 
with  undefinitized  work  authorization, 
they  have  limited  working  level 
management's  flexibility  to  work  with 
procurement  personnel  to  determine 
how  to  contract  for  change.  Manage¬ 
ment  by  quotas  tends  to  take  over, 
with  managers  and  procurement  of¬ 
fices  scored  by  how  they  minimize 
"undesirable"  (undefinitized)  actions. 
As  these  controls  change  from  watch¬ 
ing  trends,  to  management  by 
ultimatum,  such  as  "There  will  be  no 
more  undefinitized  changes  in  my 
organization,"  harmful  effects  can 
result  from  well-meaning  attempts  to 
cope  by  contractors  and  government 
managers. 
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Let  s  look  at  what  can  happen  as 
senior  officials  limit  the  flexibility  of 
contracting  officers  to  issue  formal 
change  orders  to  initiate  desired 
changes  promptly.  One  insidious 
result,  because  we  often  don't  know 
the  true  impact,  is  the  cost  of  schedule 
delay.  Where  a  production  effort  is 
underway,  delay  in  change  implemen¬ 
tation  can  mean  costly  out-of-station 
work  or  even  field  rework  or  retrofit. 
Delay  in  completion  of  items  may 
mean  a  delay  in  fielding  needed  opera¬ 
tional  capability.  A  second  action, 
which  could  result  in  negative  impact, 
misunderstanding  and  claims,  is  when 
a  contractor  senses  the  need  and  pro¬ 
ceeds  with  the  change  “at  his  own  risk" 
without  government  (PCO)  authoriza¬ 
tion.  This  means  that  the  contractor  is 
no  longer  performing  in  accordance 
with  the  written  contract.  If  the  change 
is  never  approved  and  added  to  the 
contract,  the  contractor  might  be 
unable  to  deliver  and,  thus,  not  be  paid 
for  the  work.  A  third  negative  action 
could  be  government  liability  if  the 
government  knows  that  the  contractor 
is  performing  the  changed  work,  and 
government  personnel  encourage  or 
don't  expressly  discourage  the  action. 
This  could  result  in  a  board  or  court 
ruling  that  the  contractor  was  doing 
work  for  the  government  and,  thus, 
should  be  paid.  It  is  simply  not  fair 
(unethical)  to  expect  or  encourage  con¬ 
tractors  to  work  without  proper 
authorization.  Those  who  ask  for 
work  without  proper  funding  and 
authority  risk  personal  liability  for 
violating  federal  law  and  regulation.  A 
fourth  adverse  impact  of  delay  in  con¬ 
tract  change  approval  is  in  suboptimal 
more  costly  "work-arounds"  if  a  con¬ 
tractor  stops  work  in  the  area  to  be 
changed  (perhaps  as  a  result  of  a 
government  stop  work  order). 

V.  Constructive  Changes 

Sometimes,  actions  or  inactions  by 
government  personnel  in  authority,  or 
simply  circumstances,  cause  a  contrac¬ 
tor  to  perform  work  differently  than 
required  by  the  written  contract.  This 
is  called  a  constructive  change.  A  con¬ 
tractor,  believing  existence  of  a  con¬ 
structive  change,  may  file  a  claim  for 
equitable  adjustment  in  the  contract. 
To  prevent  constructive  change  claims, 
many  acquisition  managers  and  con- 
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trading  officers  have  implemented 
educational  programs,  included 
disclaimers  for  correspondence  and 
meetings,  and  put  special  requirements 
into  contracts  to  require  timely 
notification  of  any  circumstances 
where  the  contractor  feels  that  a 
change  has  been  directed.  While  many 
people  think  that  a  constructive  change 
occurs  when  a  contractor  is  directed  to 
do  something  beyond  contract  re¬ 
quirements,  there  are  other  situations 
causing  constructive  changes  which 
may  not  be  as  preventable  or  as  "bad." 
Extra  or  different  unexpected  work 
might  be  caused  by  unforseen  prob¬ 
lems  in  vague,  insufficient,  or  defective 
specifications.  A  lack  of  timely  govern¬ 
ment  action  might  cause  the  contrac¬ 
tor  to  have  delay  cost,  called  construc¬ 
tive  deceleration.  More  work  re¬ 
quirements  than  contemplated,  such  as 
additional  work  requests  01  excessive 
government  reviews,  could  result  in  a 
claim  of  constructive  acceleration  for 
schedule  relief  and  more  money. 

VI.  Improving  Change 
Management 

Solutions  to  improve  the  manage¬ 
ment  of  the  change  process  encompass 
contracting  techniques  and  manage¬ 
ment  effort  to  improve  the  people-side 
of  the  business.  Contracting  techniques 
include  writing  contracts  with  provi¬ 
sions  to  help  manage  change  as  well  as 
taking  timely  and  professional  action 
to  change  contacts  when  needed.  Con¬ 
tractual  language  that  helps  manage 
changes  includes  incentives  like  the  op¬ 
tional  "swing”  clause  which  incor¬ 
porates  contractor  initiated  Engineer¬ 
ing  Change  Proposals  below  a  certain 
threshold  at  no  change  in  contract 
cost.  This  clause  saves  administrative 
time  in  evaluating  prices  while 
motivating  the  contractor  only  to  pro¬ 
pose  essential  changes.  Specially 
tailored  language  in  the  Special  Con¬ 
tract  Requirements  section  may  help 
limit  changes.  A  Notification  of 
Changes  clause  may  help  limit  con¬ 
structive  changes  and,  at  least,  will 
help  promote  timely  action.  Managing 
change  with  timely  actions  requires  ap¬ 
propriate  consideration  of  the  pros  and 
cons  of  undefinitized  change  orders, 
followed  by  careful  planning  and 
management  of  the  change-definitiza- 
tion  process.  When  there  is  a  heavy 


volume  of  changes,  the  contracting  of¬ 
ficer  may  group  several  changes  in  pro¬ 
cess  into  one  contract  modification  to 
avoid  duplicative  paperwork  and 
review  cycles.  Sometimes,  technical 
managers  do  this  by  holding  several 
non-urgent  charges  for  "block"  change 
or  even  a  new  model  designation  for 
configuration  management  and  logistic 
support  reasons.  Once  the  change  gets 
into  the  contract  definitization  process 
described  above,  effective  manage¬ 
ment  planning  and  follow-up  can 
make  a  big  difference.  More  than  80 
percent  of  the  change  definitization 
time  may  be  taken  up  by  activities  out¬ 
side  the  office  of  the  contracting  of¬ 
ficer.  The  effective  contracting  profes¬ 
sional  uses  overall  management  skill  in 
coordinating  and  influencing  work 
done  by  a  variety  of  activities.  When 
many  changes  are  pending,  follow-up 
actions  to  shepherd  actions  through 
the  evaluation,  audit,  pricing,  negotia¬ 
tion,  writing,  review  and  approval 
process  are  coordination  challenges  for 
management.  In  my  opinion,  good 
change  management  requires  top- 
quality  professionals  who  understand 
the  rules  and  the  process  and  who  are 
dedicated  to  getting  the  job  done  in  a 
professional  and  timely  manner.  They 
need  authority  to  make  decisions  and 
act  in  the  government’s  best  int  rest 
without  layers  of  management  rex  u’w 
and  second-guessing  to  lengthen  e 
process.  With  enough  high  quality  a  r  1 
dependable  people  working  with  i 
quirements  people  and  managers,  cor 
tracts  and  changes  can  accuratel> 
reflect  and  promote  agreement.  The 
agreement's  documenting  and  promo¬ 
tion  is,  after  all,  the  basic  reason  for 
contracts,  and  the  key  to  effective 
acquisition. 

Endnotes 

1.  For  more  on  Special  Contract  Re¬ 
quirements,  see  Beck,  A.  W.,  "Reading 
the  Fine  Print:  Special  Contract  Re¬ 
quirements,"  Contract  Management, 
March  1987. 

2.  For  more  on  the  background,  origin 
and  purpose  of  the  FAR,  see  Beck,  A. 
W.,  "FAR  is  Near,"  Program  Manager, 
September-October  1983. 

Dr.  Reck  is  Director  of  the  Business 
Manaflcnicnt  Department  at  the  Defense 
Systems  Management  Callejje. 
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The  Honorable  Robert  B.  Costello 
Under  Secretary  of  Defense  (Acquisition) 


here  are  10  major 
items  on  our  defense 
acquisition  agenda.  There 
are  different  levels  of  detail 
on  several.  1  want  to  address 
what  we  in  the  Department 
of  Defense  are  doing  to  solve 
our  problems,  which  every¬ 
one  knows  are  there. 

We  have  made  significant 
progress  in  recent  months. 

On  the  other  hand,  let's  not 
be  smug.  There's  a  lot  of 
work  to  be  done,  and  part  of 
what  I  want  to  leave  with 
you  is  a  loud  exhortation 
and  challenge  to  work  with 
us  to  make  things  better. 

The  10  agenda  items  are  these: 

1.  Bolster  the  defense  industrial  base; 

2.  Improve  the  effectiveness  of  the  acquisition  work  force; 

3.  Improve  product  quality  and  reduce  the  cost  of  poor 
quality  through  total  quality  management; 

4.  Forge  a  new  relationship  between  government  and 
industry; 

5.  Acquisition  regulatory  reform; 

6.  Reduce  the  lead  time  50  percent  for  introduction  of  new 
technology; 

7.  Develop  a  strategy  for  international  technology,  acqui¬ 
sition  and  logistics  programs; 

8.  Institute  a  cost  estimating  process  called  "could  cost," 
or  competition  in  a  sole-source  environment; 

9.  Definitely  influence  how  we  manage  special  access 
programs; 

10.  Additionally,  always  emphasize  DOD's  commitment 
to  small  and  small-disadvantaged  businesses. 


Synoptically,  these  10 
goals  and  strategies,  which 
encompass  all  program  mile¬ 
stones  during  the  acquisition 
life  cycle,  are  intended  to 
streamline  both: 

—The  methods  by  which  we 
conduct  business,  by  bring¬ 
ing  them  more  in  line  with 
commercial  business  prac¬ 
tices,  while  recognizing  cer¬ 
tain  nuances  peculiar  to 
defense  acquisition;  and 
— The  procedures  used  to 
increase  quality  and  reliabil¬ 
ity  and  reduce  weapon  sys¬ 
tems  costs. 

Our  ultimate  goal  is  to  provide  our  fighting  forces  the  best 
and  most  capable  weapon  systems  possible,  at  the  most  effi¬ 
cient  cost,  on  time,  and  fully  supportable. 

Let  me  again  emphasize  DOD's  commitment  to  small  and 
small-disadvantaged  businesses. 

Small  businesses  are  a  vital  element  in  our  national  indus¬ 
trial  base.  We  want  them  to  participate  in  defense  contrac¬ 
ting  and  have  their  fair  share  of  our  market.  We  want  them 
to  prosper  and  grow.  They  are  the  lifeblood  of  our  free  enter¬ 
prise  system. 

Last  year,  small  business  received  more  than  $26  billion 
in  DOD  prime  contract  awards,  representing  some  19  per¬ 
cent  of  our  total  prime  awards.  However,  small- 
disadvantaged  business  accounted  for  only  $3.1  billion,  or 
2.3  percent.  The  Congress  has  tasked  DOD  to  increase  the 
percentage  for  small-disadvantaged  business  to  5  percent  of 
all  procurement,  RDT&E,  military  construction  and  opera¬ 
tions  and  maintenance  dollars. 


The  challenge  is  worth  it,  and  we 
can  do  it.  To  attain  that  goal,  we  must 
rely  on  our  senior  officials  to  adjust  the 
temperature  and  build  the  right 
climate.  We  need  your  help  in  this 
area. 

We  are  calling  this  and  many  of  our 
initiatives  "cultural  changes,"  which 
take  time,  evolve  gradually,  and 
require  selling  and  cooperation.  It 
takes  leadership  to  convince  institu¬ 
tionalized  people  and  processes  that 
the  changes  will  make  everyone's  job 
easier,  and  provide  the  best  and  least 
expensive  weapons  for  the  field. 

In  today  s  severe  budgetary  con¬ 
straints,  we  must  cooperate  and  look 
for  better  ways.  Once  found,  we  must 
press  on  with  them  regardless  of  tradi¬ 
tion,  business  as  usual,  and  the  syn¬ 
drome  of  "it's  always  been  done  this 
way." 

Let's  discuss  bolstering  the  industrial 
base. 

Our  ability  to  respond  to  mobiliza¬ 
tion  is  critical.  I  measure  this  critical¬ 
ity  in  our  being  prepared  to  be  mobi¬ 
lized.  The  framework  is  DOD's  new 
industrial  alert  conditions  system, 
called  INDCONS,  where  industrial 
strength  is  called  up  in  stages. 

The  DOD  is  encouraging  industry  to 
take  a  number  of  actions  including 
modernizing  plants  and  processes, 
streamlining  management,  pooling 
resources  to  do  together  what  might 
seem  impossible  to  do  alone,  and 
restoring  the  competitive  fierceness 
that  has  not  died,  but  appears  at  times 
to  be  in  neutral. 

We  are  looking  at  regulations  to  see 
what  we  can  do  without.  If  we  don't 
need  them  for  mobilization,  do  we 
really  need  them  now  to  guide  and 
constrain  us?  We  don't  think  so. 

To  enhance  readiness  of  the  indus¬ 
trial  base,  we  are  looking  at  the  shelf- 
life  phenomenon.  Is  it  more  practical, 
for  instance,  to  have  cheaper  batteries 
or  less  stringent  packaging  require¬ 
ments?  Should  we  implement  a  "just  in 
time"  delivery  capability,  if  we  know 
we  will  use  the  material  within  a  few 
weeks? 

We  continue  to  examine  contractor 
incentives— profit  policies,  contract 
types  and  their  usage  at  various  stages 
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in  the  development  and  production 
processes;  also,  other  fundamental 
economic  incentives  bringing  us  better 
quality,  performance  and  lower  cost. 

We  are  looking  at  the  issue  of 
reverse  technology  transfer,  at  a  trade 
policy  that  allows  us  to  transfer  off¬ 
shore  technology  to  the  U.S.  industrial 
base,  for  use  by  military  as  well  as  the 
public,  especially  when  those  offshore 
contractors  are  performing  on  one  of 
our  contracts. 

We  are  looking  at  the  war  reserve 
stocks  capacity  policy  and  whether  we 
are  spending  the  right  amount  on  inven¬ 
tory.  Or,  should  we  shift  to  spending 
more  on  plant  readiness  to  achieve 
sustainability? 

In  examining  specifics  such  as 
facilities,  we  are  working  with  the  con¬ 
struction  industry  since  they  will  be  a 
factor  in  building  new  plants;  and  with 
key  labor  leaders  examining  labor-pool 
capabilities  and  the  long-term  impact 
of  their  participation. 

We  are  looking  at  strategic  materials 
used  in  weapon  systems,  with  the 
option  of  using  what  is  available;  and, 
just  as  important,  what  is  most  likely 
to  be  available  during  hostilities.  We 
may  have  to  change  our  design  con¬ 
cepts  rather  than  use  exotics  which 
might  not  be  available. 

We  have  established  a  network  with 
trade  associations  and  professional 
societies  representing  hundreds  of 
manufacturing  companies  and  more 
than  half-a-million  working  engineers. 
Yesterday,  we  gathered  more  than  200 
industry,  DOD  and  academic  leaders 
at  the  National  Defense  University  to 
seek  a  national  consensus  with  recom¬ 
mendations  on  how  to  continue  to 
move  ahead,  to  put  DOD  in  the 
lead — not  just  responding  to  what  is 
available. 

Another  of  our  major  efforts  is  in 
promoting  cooperative  efforts  within 
industry.  Two  key  examples;  the 
semiconductor  industry  and  the 
machine  tool  industry. 

The  U.S.  semiconductor  people  are 
working  together  to  create  a  not-for- 
profit  consortium  called  SEMATECH, 
which  will  develop  state-of-the-art 
manufacturing  processes.  I  am  very 
encouraged  with  this.  It  is  unprece¬ 


dented  in  that  industry,  and  may  be 
one  of  the  first  of  its  kind  in  this 
country. 

This  cooperative  effort  will  be 
watched  closely.  Industry  consortia 
may  be  just  what  we  need  to  eliminate 
unnecessary  duplication  of  effort  and 
pooling  of  scarce  resources,  plus  help¬ 
ing  U.S.  companies  gain  or  regain  a 
world-class  competitive  edge. 

In  the  machine  tool  industry,  we 
have  a  success  story.  With  our  help, 
they  have  created  the  National  Center 
for  Manufacturing  Sciences,  another 
example  of  where  manufacturers  and 
users  have  combined  resources  to  cor¬ 
rect  a  deteriorating  situation.  The 
center  is  sponsored  by  80  leading 
machine  tool  companies  and  their 
users. 

Recently,  the  Department  of 
Defense  has  initiated  the  formation  of 
two  government /industry  organiza¬ 
tions  which  I  am  confident  will  help 
solve  problems.  They  are  the  Defense 
Manufacturing  Board,  parallel  and 
equally  visible  with  the  long-standing 
Defense  Science  Board;  and  the 
Manufacturing  Advisory  Committee, 
which  has  a  goal  to  build  trust  between 
the  two. 

Let's  discuss  improving  quality 
through  the  principles  of  "total  qual¬ 
ity  management.” 

What  does  "quality"  mean?  First,  the 
word  alone  means:  the  composite  of 
material  attributes,  including  perfor¬ 
mance  features  and  characteristics  of 
a  product  or  service  to  satisfy  a  given 
need.  Translation:  Is  the  product  good, 
and  will  it  do  the  job  for  which  it  is 
intended? 

In  the  Department  of  Defense,  we 
have  expanded  application  of  the  word 
quality  and  speak  of  "total  quality 
management."  This  management  phi¬ 
losophy  is  a  strategy  already  being 
woven  into  the  fabric  of  DOD's  acqui¬ 
sition  system,  awaiting  only  the  even¬ 
tual  institutional  acceptance  as  daily 
routine.  Simply,  the  goals  are: 

—  Improve  the  quality  of  DOD 
products; 

—  Achieve  substantial  reductions  in  the 
life-cycle  cost  of  ownership  of  our 
weapon  systems. 

What  will  it  take  to  achieve  the 
goals?  A  lot. 
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—  We  must  change  the  traditional 
inspection-oriented  focus  on  quality 
which  comes  too  late  in  the  develop¬ 
ment  and  production  process,  to 
emphasize  a  built-in  quality  process 
much  earlier  in  defining  requirements 
and  early  engineering  pluses. 

—We  must  emphasize  competition 
based  on  quality  as  well  as  cost, 
schedule  and  performance,  including 
lowest  bid. 

—  We  must  motivate  and  exploit  the 
ingenuity  and  innovativeness  of  our 
people  to  achieve  maximum  quality 
improvements  in  every  program  at 
every  level.  This  will  be  the  program 
manager's  responsibility. 

— We  must  encourage  implementation 
of  successful  concepts  such  as 
statistical  process  control  and  con¬ 
tinuous  process  improvements. 

—We  must  emphasize  the  use  of 
sound,  proyed  engineering  design  and 
manufacturing  practices. 

Our  objectives  include:  making  our 
procurement  system  more  flexible  to 
allow  streamlining  of  contractual 
requirements:  improving  interaction 
among  designers,  manufacturers,  logis¬ 
ticians  and  users;  making  quality  a  fac¬ 
tor  in  source  selection;  giving  extra 
consideration  to  companies  whose  pro¬ 
ducts  and  services  embody  the  new 
concept  of  continuous  product 
improvement. 

To  implement  the  strategy  we  will: 

—  Integrate  current  DOD  management 
initiatives  affecting  quality  such  as 
acquisition  streamlining,  competition, 
improving  the  transition  from  develop¬ 
ment  to  production,  value  engineering, 
warranties,  and  gain  sharing; 

—  Revise  all  product  specifications  to 
replace  the  "acceptable  quality  level" 
concept  with  a  "continuous  quality 
improvement"  concept; 

—  Stimulate  use  of  new  technology  to 
enhance  quality; 

—  Guide  the  radical  change  from 
reliance  on  detecting  defects  during 
end-item  inspection  to  an  effective  pro¬ 
cess  control  that  prevents  defects  dur¬ 
ing  manufacturing; 

—  Apply  quality  technology  including 
automated  process  controls,  self  cor¬ 
recting  manufacturing  processes,  built- 
in  diagnostics  and  automatic 
inspections; 


—  Institute  an  integrated  training  pro¬ 
gram  to  instill  quality  principles 
throughout  the  government,  including 
developing  a  career  program  for  qual¬ 
ity  assurance  personnel; 

—  Encourage  contracting  officers  to 
look  for  ways  to  increase  quality  when 
preparing  requests  for  proposals  and 
negotiating  contracts. 

We  are  trying  to  change  another 
outmoded  concept,  that  of  “minimum 
acceptable"  quality.  America's 
manufacturers  have  pursued  this  con¬ 
cept,  placidly  resigned  to  a  persistent 
level  of  errors — perceived  as  irreduc¬ 
ible  and  as  being  the  way  of  life.  It 
isn't. 

The  Office  of  the  Secretary  of 
Defense  is  working  with  the  services  to 
identify  key  approaches.  Many  ex¬ 
cellent  tools  have  been  developed.  We 
are  exploring  more  ways  to  hold  pro¬ 
gram  managers  accountable  for  qual¬ 
ity.  I  want  you  involved  and  commit¬ 
ted.  Pilot  acquisition  programs  will  be 
selected.  We  will  make  the  necessary 
changes  to  the  Federal  Acquisition 
Regulations  to  incorporate  the  new 
approaches. 

It  behooves  both  the  Department  of 
Defense  and  industry  to  work  together. 
Industry  must  provide  tangible 
evidence  of  its  commitment  to  quality. 
Statistical  process  control  and  total 
quality  management  are  not  just  floor 
activities;  they  belong  upstairs  as  well. 
Management  must  openly  assume 
responsibility  for  their  product's  qual¬ 
ity  and  insist  that  "no  defective  prod¬ 
ucts  shall  be  shipped  to  the  government." 

Let's  discuss  regulatory  reform. 
When  we  say  regulatory,  we  are  talk¬ 
ing  about  the  defense  contracting 
system. 

Our  goal  is  to  make  it  easier  and 
quicker  for  managers  and  people  in  the 
field  to  get  the  quality  products  and 
services  they  require,  when  they  want 
them,  and  at  a  reasonable  price. 

We  want  to  move  into  a  system 
where  our  contracting  officers  will  feel 
at  home  using  their  initiative  and  in¬ 
novativeness  to  provide  the  govern¬ 
ment  with  those  products  and  services, 
while  maintaining  proper  accountabil¬ 
ity.  Defense  contracting  officers  are 
not  using  all  the  authority  the  laws  and 
regulations  have  given  them  — for 


various  reasons.  We  are  encouraging 
them  to  escape  from  their  perceived 
constrained  and  restricted  environment 
to  one  where  they  can  exercise  good 
judgment  more  in  line  with  sound 
commercial  practices  to  make  good, 
solid  business  decisions.  We  want 
quality  and  timeliness  to  be  decisive 
factors,  not  just  price  alone. 

We  have  taken  a  major  step  in  this 
direction  with  our  pilot  contracting 
activity  program.  This  involves  31 
activities  of  the  services  and  the 
Defense  Logistics  Agency.  Included  are 
the  Army  Tank-Automotive  Com¬ 
mand  and  the  \ir  Force  Electronic 
Systems  Division;  the  Navy  Ships 
Parts  Control  Center;  and  the  Defense 
Industrial  Supply  Center.  We  estab¬ 
lished  this  program  to  capitalize  on  the 
enthusiasm  of  people  in  the  field.  We 
are  allowing  contracting  officers  to 
show  initiative  and  creativeness  while 
working  within  the  law. 

We  are  identifying  procurement 
laws  and  regulations  that  are  unneces¬ 
sarily  complex  and  restrictive,  testing 
new  and  different  procurement 
methods,  and  performing  more  pro¬ 
curement  actions  using  commercial 
practices.  Under  the  test,  contracting 
officers  may  issue  class  deviations  to 
the  Federal  Acquisition  Regulation  and 
its  defense  supplement,  and  waive  any 
DOD  procurement  regulation  not 
required  by  statute  or  executive  order. 

Since  98  percent  of  DOD's  procure¬ 
ment  actions  are  for  less  than  $25,000, 
we  are  producing  a  new  Small  Pur¬ 
chase  Handbook,  which  will  be  out 
soon,  to  streamline  these  kinds  of  pro¬ 
curements.  For  items  already  on  the 
competed  federal  supply  schedule  of 
the  General  Services  Administration, 
our  contracting  people  no  longer  have 
to  recompete  in  order  to  procure  them. 

The  principle  of  "could  cost"  is  a 
new  concept  in  the  acquisition 
vocabulary.  It  introduces  competition 
in  a  sole-source  environment,  which 
amounts  to  some  40  percent  of  DOD's 
contract  actions,  and  can  supplement 
the  other  60  percent  of  negotiations  as 
well.  We  would  use  this  concept  to 
reduce  the  cost  of  many  special  access 
and  follow-on  programs;  also,  pro¬ 
grams  in  production  where  we  can't 

(See  AGENDA  ITEMS ,  pane  31) 
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ne  objective  of 
this  article  is  to 
discuss  the  matters  which 
drive  the  decision-making 
process  of  the  senior  officers 
of  major  defense  contrac¬ 
tors.  Many  Defense  Depart¬ 
ment  managers,  who  have 
tried  to  induce  contractors  to 
make  capital  investments 
through  the  weighted  guide¬ 
lines  profit  formulas,  and 
others  concerned  with  de¬ 
fense  contract  profit  policy, 
will  be  surprised  to  learn  that  the  decision-drivers  in  the  real 
world  are  not  what  they  assumed. 

A  second  objective  is  to  demonstrate  that  annual  fluctua¬ 
tions  in  profitability  are  of  limited  usefulness  in  setting 
government  policy  without  taking  into  account  the  com¬ 
pany's  program  mix — from  initial  development  through  full- 
scale  production  — from  year  to  year.  Profits  should  and  do 
vary  widely  depending  on  which  end  of  the  develop¬ 
ment/production  scale  a  particular  program  resides  at  any 
given  year.  The  learning  curve  obviously  has  a  major  im¬ 
pact  on  productivity  and  profitability. 

A  third  objective  is  to  show  that  profit  comparisons 
among  defense  firms,  and  especially  between  defense 
weapon  system  companies  and  commercial  enterprise,  are 
of  dubious  value  without  extensive  analyses  of  the  type  sug¬ 
gested  above. 

Finally,  a  major  purpose  is  to  emphasize  the  importance 
of  an  understanding  by  Department  of  Defense  program 


managers  and  contracting 
officers,  and  their  superiors, 
that  their  real  objective  in 
negotiation  is  to  select  con¬ 
tractors  who  will  produce 
the  quality  and  reliability 
needed,  at  a  reasonable  price 
and  low  total  or  life-cycle 
cost  to  the  government,  not 
at  a  low  price  or  profit.  The 
goal  in  research  into  profit¬ 
ability  trends  should  be  to 
find  better  techniques  for 
producing  the  financial  and 
related  incentives  leading  to  this  end  result;  i.e.,  high 
quality  and  reliability  at  a  reasonable  price  and  low  overall 
cost.  Intensive  focus  on  the  low  bid  and  capital  investment 
can  be  counterproductive. 

Principles 

Profit  policy  rationally  should  be  related  to  the  national 
defense  objectives  of  the  Department  of  Defense  and  its  con¬ 
tracting  officers.  If  it  is  to  work  it  should  also  relate  to  the 
investment  decision  considerations  of  defense  contractors. 

The  contracting  mission  is  to  supply  the  armed  forces  with 
weapons  and  other  products  that  perform  as  required,  in 
the  needed  quantitites,  on  time,  properly  supported,  and  at 
a  reasonable  total  cost. 

These  products  may  be  needed  to  meet  a  threat  or  to  cor¬ 
rect  a  weapon  system  deficiency.  The  need  may  be 
technology  based.  The  technology  may  be  available,  or  have 
to  be  developed. 
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The  broad  defense  objectives  are  to 
support  foreign  policy  and  deterrence, 
provide  fighting  capability,  and  assure 
the  personal  safety  of  Armed  Forces 
personnel. 

Acquisition  policy  should  support 
that  mission  and  those  objectives.  This 
applies  to  contracting,  financing,  prof¬ 
it  and  pricing. 

These  objectives  and  mission  require 
a  healthy,  innovative,  efficient,  com¬ 
petitive  defense  industry  base. 

It  follows  that  defense  industry  must 
be  competitive  in  advancing  tech¬ 
nology,  and  in  product  markets.  Most 
importantly,  it  must  be  competitive  in 
the  capital  market— where  it  seeks  the 
equity  and  debt  capital  required  to 
compete  in  the  advance  of  technology 
and  in  selling  its  products.  It  takes  cash 
to  compete. 

The  Department  of  Defense  should 
incentivize  well-managed  effective 
competitors  and  low-cost  producers 
(not  necessarily  "low  bidders")  to  in¬ 
vest  in  competing  for  defense  business. 
And,  indirectly,  it  should  not  only  in¬ 
centivize  the  capital  market  to  buy 
stock  in  and  lend  to  such  companies, 
it  should  incentivize  entrepreneurs  to 
create  such  companies. 

Department  of  Defense  incentive 
policies  should  give  consideration  to  all 
elements  of  a  well-managed,  healthy, 
competitive,  innovative  industrial 
mobilization  base:  prime  contractors, 
subcontractors,  vendors;  large  and 
small;  publicly  owned  and  private. 

Assuming  success  in  incentivizing  or 
attracting  successful  and  well-managed 
companies  to  compete,  the  Depart¬ 
ment  of  Defense  should  leave  it  to 
them  to  decide  how  to  invest.  Driven 
by  defense  market  and  capital  market 
considerations,  successful  firms  will 
make  wise  decisions. 

The  capital  market  invests  in  com¬ 
panies,  equity  and  debt  capital,  for  an 
adequate  return  on  investment,  con¬ 
sidering  the  time  value  of  money  in¬ 
volved,  as  well  as  risk.  Return  on  in¬ 
vestment  may  be  called  ROI,  or  ROA 
(assets),  or  ROCE  (capital  employed). 

To  succeed  in  incentivizing  invest¬ 
ment  to  compete,  the  Department  of 
Defense  policy  should  have  a  rational 
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relationship  to  the  company  manager's 
investment  decision  process.  It  should 
affect  matters  the  manager  logically 
thinks  of  as  important  in  deciding  to 
invest. 

The  policy  should  recognize  that,  in 
a  given  company  at  a  given  time,  there 
will  be  a  variety  of  investment  oppor¬ 
tunities  that  might  be  likely  to  increase 
productivity,  not  just  "capital  invest¬ 
ment.” 

Company  Investment  Decision 

Managers  of  a  company  are,  in  ef¬ 
fect,  trustees  charged  to  protect  the 
capital  invested  in  it,  and  to  earn  a 
reasonable  return  on  it  (ROI).  That  is 
a  serious  obligation,  particularly  if 
company  stock  is  widely  owned  by  the 
public. 

Managers  of  a  company  deploy 
resources,  or  invest  its  capital,  to  ob¬ 
tain  an  adequate  ROI.  They  may  in¬ 
vest  for  long-term  or  shert-term  ROI, 
probably  both  at  the  same  time  though 
in  different  projects.  When  the  return 
is  long-term,  it  must  be  much  higher 
when  it  does  come,  to  compensate  for 
years  when  the  capital  was  tied  up  not 
generating  current  return.  This  concept 
is  called  the  "time  value"  of  money. 

We  say  company  investment  is  "ROI 
justified."  This  means  we  make  the  in¬ 
vestment  only  if; 

— After  considering  probability  of  suc¬ 
cess,  and 

—After  considering  risk,  and 
— After  discounting  estimated  future 
cash  flow  returns  back  to  their  "pres¬ 
ent  value,"  to  account  for  "time  value," 
—The  net  positive  cash  flow  amounts 
to  a  return  on  investment  that 

—Satisfies  or  meets  the  company's 
"hurdle  rate"  or  its  "cost  of  capital"  in 
the  financial  market,  and 

—Is  a  better  opportunity  than 
other  available  investment  oppor¬ 
tunities.  The  profit  we  would  have 
made  on  the  investment  we  have  to 
forego  is  thought  of  as  a  "cost"  of  the 
investment  we  do  pursue.  This  is  the 
concept  of  "opportunity  cost." 

—The  cash  investment  is  affordable. 

The  evaluation  of  the  alternative  in¬ 
vestment  opportunities  (e.g.,  develop 
a  weapon  system,  or  pursue  a  commer¬ 
cial  market,  or  automate  a  factory,  or 


prevent  a  layoff)  is  done  as  realisti¬ 
cally  as  possible.  It  may  involve 
forecasting  years  ahead.  It  is  done  in 
terms  of  cash  flows — out  and  back  in, 
not  just  in  financial  accounting  terms. 
Cash  flows  are  reality.  Financial  ac¬ 
counting  terms  such  as  "net  income," 
"profit  margin"  and  "depreciation"  do 
not  always  reflect  cash  flows.  Tech¬ 
niques  used  in  the  process  are  "inter¬ 
nal  project  rate  of  return"  analysis  and 
"discounted  cash  flow  net  present 
value"  analysis,  both  technical  terms 
for  ROI  justification,  and  by 
"payback"  analysis  which  helps  with 
risk  evaluation.  Payback  is  the  number 
of  months  until  the  investment  is 
recovered,  without  any  profit. 

It  may  be  useful  to  think  of  the 
"hurdle  rate"  or  "cost  of  capital"  as  the 
rate  of  return  on  capital  the  company 
must  realize  over  time.  If  it  does  not, 
its  stock  price  will  decline  and  its  cost 
to  borrow  money  will  rise;  that  is,  it 
will  not  be  competitive  in  the  free 
capital  market. 

Affordability  of  the  investment 
means  the  company  must  plan  to  have 
or  generate  cash  required  for  the  in¬ 
vestment,  possibly  during  some  years 
ahead.  The  company  must  assure  its 
planning  protects  that  cash  from  com¬ 
mitment  to  any  other  use.  That  cash 
may  come  from  another  program  in 
the  company's  "investment  portfolio," 
which  is  now  reaching  its  "mature" 
phase  when  positive  cash  return  is 
realized. 

Most  company  resources  have  a 
limit,  and  investment  opportunities 
vary  as  to  time  span  of  the  investment, 
probability  of  success,  risk  of  failure 
of  the  project,  and  risk  of  financial 
disaster. 

"Earning  per  share"  impact  of  the  in¬ 
vestment  decision  must  be  considered 
because  current  market  price  of  stock 
may  be  affected  by  earnings  fluctua¬ 
tion.  Stock  price  volatility  can  affect 
capital  market  strength  of  the  com¬ 
pany  and  even  its  vulnerability  to 
"takeover"  and  "bust  up"  by  corporate 
raiders.  Protection  of  earnings  per 
share  may  require  a  focus  on  short¬ 
term  results,  not  just  long-term  return 
on  investment. 

The  company  may  invest  by  using 
a  "portfolio  strategy,"  trying  to  pursue 
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long-term  investments  in  market  entry 
and  market  share  capture  for  some 
products,  while  at  the  same  time 
managing  other  products  which  are 
currently  generating  positive  cash  flow 
and  financial  accounting  "earnings." 
This  was  recognized  in  the  1985 
"Defense  Financial  and  Investment 
Review"  (DFAIR)  by  the  Office  of  the 
Secretary  of  Defense.1  This  is  the 
balanced  "Portfolio"  strategic  manage¬ 
ment  concept  developed  by  the  Boston 
Consulting  Group  (BCG).  The  posi¬ 
tive  cash  flows  from  products  in  the 
mature  phase  provide  funds  for  the 
investments. 

Each  firm's  investment  decision 
takes  into  account  multiple  interrelated 
considerations  including  resources,  af¬ 
fordability  and  market  position,  tech¬ 
nology  position,  market  and  customer 
behavior,  competitors'  positions, 
strategy  and  tactics,  talent  available, 
know-how,  reputation,  policy  regard¬ 
ing  maintenance  of  job  security  and 
avoidance  of  lay  off,  and  corporate 
culture  and  values.  A  major  considera¬ 
tion  in  corporate  investment  decisions 
is  the  relative  degree  of  certainty  re¬ 
garding  increased  sales  likely  to  result 
from  the  investment.  In  the  case  of 
defense,  with  only  a  1-year  congres¬ 
sional  budget,  there  is  extremely  high 
uncertainty  and,  thus,  a  considerable 
disincentive  to  investment. 

The  company  will  consider  risk  of 
failure  (loss  of  the  investment  or  loss 
of  better  opportunity)  and  risk  of 
financial  disaster.  In  the  defense  busi¬ 
ness,  it  is  dealing  with  an  often  unpre¬ 
dictable  government  customer  with 
both  monopsony  (where  several  sellers 
have  only  one  buyer)  and  sovereign 
power  which  the  customer  may  exer¬ 
cise  in  damaging  ways.  The  company 
is  not  likely  to  limit  its  risk  analysis  in 
the  simple  way  suggested  by  the 
General  Accounting  Office  (GAO) 
when  it  says  defense  business  is  low 
risk.  The  question  is  not  simply  more 
or  less  profit.  (See  GAO  Assessment  of 
the  Study  of  Defense  Contractor  Prof¬ 
itability,  December  1986,  page  34, 
comparing  defense  and  commercial 
firm  risk.) 

The  company  may  be  large,  mid-size 
or  small.  It  may  be  a  prime  contrac¬ 
tor,  subcontractor  or  vendor. 

The  company  may  be  deciding 
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among  various  investment  objectives 
such  as  whether  to  invest  in  technology 
(research  and  development),  market 
entry  in  a  new  field,  cost-share  or  buy- 
in.  (A  fixed  price  contract  "buy-in" 
may  be  fully  disclosed  in  the  proposal, 
and  need  not  be  improper  or  covert.) 
Other  investment  objectives  may  in¬ 
clude  capture  or  defense  of  market 
share,  know-how  and  learning-curve 
position  to  drive  down  cost  hiring, 
training,  prevention  of  lay-off,  em¬ 
ployees'  incentives,  or  capital  facilities. 
The  last  mentioned  may  cover  a  wide 
range,  including  capital  expenditures 
for  office,  lab,  manufacture,  quality, 
test,  or  working  conditions  and  morale 
support;  any  may  be  of  value  and  a 
justified  investment  at  a  particular 
time. 

Government  Profit  Policy 

How  well  is  government  prof’t 
policy  coupled  to  defense  contractors' 
investment  decisions? 

Consider  a  government  view,  as  ex¬ 
pressed  in  the  GAO  Exposure  Draft,  A 
Proposal  for  A  Program  to  Study  the 
Profitability  of  Government  Contrac¬ 
tors,  November  1986: 

It  is  in  the  government's  interest 
to  offer  contractors  opportunities 
for  profit  sufficient  to  (1)  stimu¬ 
late  efficient  contract  perfor¬ 
mance,  (2)  not  discourage  com¬ 
panies  from  seeking  government 
business,  and  (3)  promote  invest¬ 
ment  to  enhance  productivity, 
and  provide  for  an  adequate  in¬ 
dustrial  base,  that  will  allow  a 
quick  buildup  of  defense  items  in 
case  of  emergency. 

A  number  of  questions  arise. 

—  "Stimulate  efficient  performance?” 
What  does  "efficient"  mean?  Low  cost, 
or  low  price?  Low  life-cycle  cost7 
Quality?  "Efficient"  may  mean  highly 
automated.  But  that  may  mean  high 
depreciation  and,  therefore,  high 
"overhead"— and  high  fixed  costs  to 
carry  in  times  of  low  demand— a  high 
break-even  point.  Would  investment 
in  engineering  hours  to  design  a 
product  so  as  to  be  more  easily  pro¬ 
ducible  instead  of  automating  con¬ 
tribute  to  "efficiency?" 

—  "Not  discourage  companies?" 
Would  a  less  negative  policy— like  "en¬ 


courage"— be  more  incentive  to  invest? 
And  what  "companies?"  Just  any  com¬ 
pany?  Or  well-managed,  effective 
competitors?  Low-cost  producers,  or 
"low  bidders?"  Prime  contractors,  or 
also  subcontractors  and  vendors? 

— "Promote  investment  to  enhance 
productivity?"  The  GAO  seems  to 
favor  capital  investment  to  do  that.2 
So  does  DOD.  The  GAO  says,  "For 
example,  the  Department  implemented 
recommendations  of  its  Profit  '76 
study  to  induce  contractors  to  invest 
in  capital  facilities."  The  GAO  wants 
it  to  be  statutory.  Section  2  of  the 
GAO  draft  proposed  "Profit  Reports 
Act  of  1986  used  the  language:  "...pro¬ 
vide  profits  that  encourage  related 
capital  investment...."3 

What  if  the  policy  were  not  to  incen- 
tivize  capital  investment  but  to  incen- 
tivize  well-managed  effective  com¬ 
petitors  to  compete  across  the  board 
for  defense  business?  If  that  were  ef¬ 
fective  could  it  then  be  left  to  those  ex¬ 
cellent  managers  to  decide  what  to  in¬ 
vest  in  and  when?  Wouldn't  the  value 
systems  of  such  effective  competitors 
and  their  competent  managers  lead 
them  to  invest  for  productivity,  quali¬ 
ty,  and  cost  reduction?  Absolute  prof¬ 
it  on  a  subsequent  contract  may  be  less 
if  cost  is  less,  but  there  should  be  more 
overall  business,  and  a  more  effective 
and,  therefore,  more  secure  and  en¬ 
thusiastic  work  force.4  The  right  in¬ 
vestment  to  bring  this  about  might  or 
might  not  be  capital.  As  noted,  many 
opportunities  to  invest  to  improve 
quality  and  productivity  do  not  in¬ 
volve  "capital  expenditure." 

In  any  event,  the  government  seems 
to  have  sought  to  incentivize  capital  in¬ 
vestment  by  a  "profit  policy"  applied 
through  "weighted  guidelines"  used  for 
negotiation,  which,  in  the  main,  deal 
with  "profit"  as  a  percentage  of  ex¬ 
pected  cost;  or  deal  with  profit  margin 
(net  income  after  tax  as  a  percentage 
of  sales).  It  is  far  from  conclusive  that 
it  has  worked. 

According  to  an  Air  Force  Systems 
Coi.w.iuiid  (AFSC)  study,  "the 
operating  premise  of  the  Profit  76 
study  team  and  the  ensuing  DPC  76-3 
was  that  a  higher  return  on  sales  for 
defense  contracts  would  yield  higher 
capital  investment.  Results  of  the 
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AFSC  Profit  Study  '82  raised  doubt 
about  this  premise,  "...capital  invest¬ 
ment  on  defense  contracts  as  a  percen¬ 
tage  of  total  contract  costs  did  not 
change  during  the  1977-81  period."5 

The  AFSC  Study  continued: 

Defense  contractors  perceived  that  the 
Weighted  Guidelines  method  is  not  the 
real  determinant  of  profit.  They  felt 
that  management  direction  has  a 
greater  impact  on  profit  determination. 
This  perception  was  also  confirmed  by 
government  contracting  personnel 
who  shared  the  belief  that  profit  is 
largely  determined  by  management, 
regardless  of  Weighted  Guidelines 
computation."0  Conclusions  like  this 
cause  one  to  inquire  whether  the  prof¬ 
it  policy  implementation,  with  all  its 
complexity,  is  largely  a  ritual. 

Even  if  the  policy  did  encourage  in¬ 
vestment  in  capital  equipment  for  pro¬ 
ductivity,  is  il  r.asonable  to  think  that 
companies  will  or  can  make  ROI  jus¬ 
tified  investments  in  capital  capacity 
for  "a  quick  buildup  of  defense  items 
in  case  of  emergency,"  as  GAO  wants? 
Isn't  a  "surge"  requirement  for  weap¬ 
ons,  or  war,  a  market  we  hope  will  not 
come?  Isn't  the  very  mission  deter¬ 
rence?  Should  the  government  as  sov¬ 
ereign  ensure  that  surge  capacity  is  in 
place  where  it  would  be  needed,  and 
not  rely  on  profit  on  current  business 
as  an  incentive  for  that?  Of  course  a 
healthy,  innovative,  competitive  in¬ 
dustry  with  capacity  to  meet  current 
military  requirements  for  deterrence  is 
a  necessary  mobilization  base. 

As  noted  by  AFSC,  the  government 
has  manipulated  profit  margin  in  an  ef¬ 
fort  to  incentivize  the  desired  invest¬ 
ment  in  capital  facilities.  It  should  not 
be  surprising  that  it  has  not  worked. 
We  suggest  that  it  also  would  not  work 
for  the  broader,  and  arguably  more  ra¬ 
tional,  objective  of  incentivizing  effec¬ 
tive  competitors  to  compete  across  the 
board  for  defense  business. 

Profitability  -  DuPont  Formula  - 
Asset  Management 

Mere  changes  in  profit  margin, 
taken  alone,  do  not  have  a  sufficient¬ 
ly  rational  relationship  to  the  matters 
company  managers  think  about  when 
making  company  investment  decisions 
in  the  defense  business. 


The  National  Security  Industrial 
Association  (NS1A)7  told  The  Office 
of  Secretary  of  Defense  (OSD)  at  the 
outset  of  Profit  '76  that  its  approach 
would  not  work,  considering  the  com¬ 
plex  of  considerations,  beyond  profit 
margin,  involved  in  the  company  in¬ 
vestment  decision. 

The  company  decision  is  ROI 
justified,  not  profit  margin  justified. 
Profit  margin  is  only  part  of  ROI.  It 
should  be  useful  to  refer  to  the  "for¬ 
mula"  for  ROI  developed  by  the 
DuPont  Company  years  ago.  Accord¬ 
ing  to  the  "DuPont  formula": 

Profit  Margin  X  Asset  Turnover  = 
ROI 

or 

Net  Income/Sales  X  Sales/Total 
Assets  =  Net  Income/Total  Assets 

or 

NI/S  X  S/TA  =  NI/TA 

Asset  turnover,  or  S/TA,  is  efficien¬ 
cy;  that  is,  doing  more  business,  or  get¬ 
ting  out  more  product,  with  less  assets. 
Efficiency  reduces  cost.  Idle  or  under¬ 
utilized  assets  slow  asset  turnover. 

The  DuPont  formula  is  a  powerful 
management  concept,  not  just  a  finan¬ 
cial  formula.  Peter  Drucker  says  that 
when  the  DuPont  Company  "codified" 
the  concept  in  the  1920s,  it  then 
"organized"  its  management  around  it. 
Ffe  said  "working  on  the  productivity 
of  capital  is  the  easiest  and  usually  the 
quickest  way  to  improve  the  profita¬ 
bility  of  a  business...";  i.e.,  working  on 
asset  turnover,  or  S/TA.8 

The  concepts  embodied  in  the 
DuPont  formula  were  underscored  in 
a  letter  from  the  President  of  Textron 
to  OSD  at  the  outset  of  Profit  76. 
Speaking  of  the  defense  industry,  he 
said: 

Profits  on  Sales,  of  course,  will 
be  lower  than  for  the  average  of 
American  industry;  this  has  been 
proven  so  many  times  that  it 
hardly  need  be  repeated.  How¬ 
ever...  those  companies  that  sur¬ 
vive  should,  in  the  long  run, 
make  a  competitive  return  on  in¬ 
vestment. ..Defense. ..is  a  busi¬ 
ness  in  which  asset  management 
is  a  key  element,  and  the  turn¬ 
over  rate  (sales  divided  by  net 
worth)  can  be  the  difference  be¬ 


tween  success  and  failure.  High 
turnover  usually  comes  only  in 
the  mature  phase  of  production 
contracts... one  must  take  the 
high  risk  in...  the  earlier 
phases. .  .when  profits  are  low 
and  development  is  speculative. 
One  must  invest  for  the  long 
haul. . ,.9 

Profit  76,  DFA1R  and  GAO  do,  of 
course,  refer  to  ROI  and  ROA  among 
other  profit  measures.  But,  annual  ROI 
in  financial  accounting  terms  must  be 
distinguished  from  program  ROI,  over 
time,  in  cash  terms,  which  is  reality  in 
the  investment  evaluation.  And, 
DFAIR  and  GAO  do  affect  turnover  or 
S/TA  when  they  deal  with  progress 
payments  and  financing;  e.g.,  they 
hurt  S/TA  when  they  cut  progress 
payments,  but,  mostly,  they  do  not 
deal  with  major  asset  management 
problems.  They  deal  largely  with 
manipulations  of  the  relationship  of 
pre-tax  profit  to  allowable  cost.  Those 
actions  are  hardly  considered  in  the 
company  investment  decision;  they  are 
washed  away  by  the  asset  management 
(S/TA)  problems.10 

To  deal  effectively  with  ROI  re¬ 
quires  consideration  of  asset  turnover 
(S/TA),  the  measure  of  efficiency,  and 
asset  management.  Asset  turnover  in¬ 
dicates  the  ability  to  make  full,  effec¬ 
tive,  continuous  use  of  company 
assets,  meaning  its  physical  assets,  and 
its  people;  i.e.,  their  brains,  skills, 
learning,  loyalty,  and  motivation  as 
individuals  and  as  multidiscipline 
teams.  It  requires  good  management 
stability  and  continuity. 

Strategic  Investment  Considera¬ 
tions — "Experience"  and  "Portfolio" 

Learning  curve  and  the  related 
experience-curve  phenomena  enter  in¬ 
to  strategic  investment  decisions. 
Learning-curve  theory  holds  that  unit 
factory  labor  cost  declines  at  a  predict¬ 
able  fixed  percentage  every  time 
cumulative  volume  of  the  product 
manufactured  over  time  increases; 
e.g.,  10  percent  to  15  percent  with  each 
doubling.  The  concept  is  weii  known 
in  defense  contract  pricing.  Just  as  in 
the  case  of  asset  turnover  or  S/TA, 
learning  by  the  work  force  requ  res 
good  management  and  stability.  Ex¬ 
perience-curve  theory,  promulgated 
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and  tested  since  l°oo  by  the  Boston 
Consulting  Group,  holds  that  labor 
hour  cost  declines  trom  factory 
learning  tar  less  than  declines  in  the 
total  cost  of  complex  products  as  ac¬ 
cumulated  experience  of  the  total 
organization  increases.  Both  aspects  of 
cost  decline  are  important  to  asset 
turnover  and  efficiency.  Both  are  im¬ 
portant  to  product  quality.  Both  are 
important  to  corporate  strategy  and 
long-term  investment.  Market  share 
capture  and  market  position  defense 
aie  aimed  at  competitive  cost  reduc¬ 
tion  and  competitive  advantage, 
through  the  learning  that  comes  with 
volume.  Investment  strategy  in  these 
terms  is  based  on  long-term  discounted 
cash  flow  analysis-  r-,sh  paid  out  to 
capture  market  share  and  learning  and 
experience,  matched  against  cash  re¬ 
ceived  back  when  low  unit  cost  com¬ 
pared  to  competitors  is  achieved.  An¬ 
nual  reported  earnings,"  or  ROI,  tell 
little  about  company  health  in  terms  of 
such  strategic  long-term  investment 
programs.  This  important  thing  is 
positive  program  net  cash  flow  ROA 
over  time,  discounted  for  time  value. 

The  company  managing  that  type  of 
program  well  over  time,  with  mature, 
low-unit-cost  product  lines  throwing 
off  cash  to  fund  research  and  develop¬ 
ment,  early  start  up,  and  pursuit  of 
market  share  in  new  product  lines,  in 
a  "portfolio"  of  ventures  with  different 
time  horizons,  is  likely  to  be  a  healthy 
and  valuable  component  of  the  defense 
industrial  base  (BCG  Concept). 

Achievement  of  cost  declines  by 
learning  and  experience  depends,  as 
does  effective  asset  management,  on 
several  preconditions:  good  manage¬ 
ment,  appropriate  incentives  for  quali¬ 
ty  improvement  and  cost  reduction, 
and  stability  ot  operations,  so  that 
there  is  opportunity  for  full  and  effec¬ 
tive  and  continuous  use  of  plant  assets 
and  peoples'  skills  and  motivation.  The 
company  decision-maker  evaluating 
iiwexunent  opportunities  must  weigh 
the  effect  of  probable  instability  on 
volume  production  quantities,  learn¬ 
ing,  experience,  cost  decline,  and  asset 
turnover:  All  affect  the  ultimate  return 
flow  of  cash  which,  discounted  back 
‘o  present  value,  must  justify  the  in¬ 
vestment  in  terms  of  a  "cost  of  capital" 
or  hurdle  rate  of  return.  In  some 
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aspects  of  the  defense  business,  such  as 
heavy  capital  investment  or  fixed  price 
development  contracting,  there  is  the 
chance  of  disaster — betting  the  com¬ 
pany  or  career. 

Profit  Policy,  Reality 

Government  profit  policy,  based  on 
repetitive  costly  studies  and  seem¬ 
ingly  endless  finepoint  debates,  deals 
with  the  relationship  of  pre-tax  profit 
to  allowable  cost  through  the 
"weighted  guidelines."  It  attempts  to 
increase  profit  margin,  or  decrease  it, 
in  this  way,  by  controlling  its  negoti¬ 
ators  and  contracting  officers  by  ex¬ 
plicit  direction  in  the  "guidelines."  Sec¬ 
tion  2  of  the  GAO  proposed  Profit 
Reports  Act  of  1986  says:". ..provide 
profits  that... are  reasonable  in  light 
of... profits  contractors  earn  on... 
similar  private  sector  business."11 
What  considerations  affect  "reason¬ 
able"  and  "similar?"  Do  they  include 
attractiveness  of  ROI  over  time  to 
lenders  and  equity  investors?  Does 
"similar”  take  into  consideration  the 
position  of  the  business  on  the  ex¬ 
perience  curve;  the  position  of  the  pro¬ 
gram  or  business  or  its  phase  in  the 
company  strategic  portfolio;  start-up, 
market-share  pursuit,  or  the  mature 
production  phase  when  real  return  is 
realized?  Is  the  competitive  rank  of  the 
company— and  trend— gaining  market 
share,  slipping,  or  liquidating?  As  to 
ROI  "reasonableness,"  is  it  "annual"  or 
"program"  based?  Is  it  cash  or  "book 
accounting?" 

What  makes  the  profit  of  a  "similar 
private  sector  business"  relevant?  Are 
its  risks  "similar?"  The  defense  com¬ 
pany  competes  against  all  businesses  to 
get  cash  from  investors. 

The  government  cannot  say  whether 
its  "profit  policy"  is  "effective."  "Prof¬ 
it  82"  said  no;  DFAIR  and  the  GAO 
appear  to  differ  on  the  matter.  The 
GAO  says:  "...defense  firms  continue 
to  exhibit  low  relative  investment  com¬ 
pared  with  non-defense  firms,  and  the 
gap  appears  to  be  widening.  This  con¬ 
tradicts  the  DFAIR  suggestion  that  the 
gap  is  narrowing."12  The  DFAIR  ap¬ 
pears  to  show  concern  that  in  the 
defense  industry  it  found  "building  ex¬ 
penditures  increasing  at  the  expense  of 
equipment."13 


Investment  and  Asset  Manage¬ 
ment — Instability 

As  noted  earlier,  investment  is  not 
likely  to  be  encouraged  by  profit 
margin  changes  alone  because  effi¬ 
ciency,  S/TA,  is  an  essential  factor  in 
ROI.  The  government  as  sovereign 
and  as  monopsonistic  customer  estab¬ 
lishes  laws,  regulations,  policies  and 
practices  which  adversely  affect  effec¬ 
tive  asset  turnover,  and  make  an  ade¬ 
quate  ROI  unnecessarily  uncertain. 
Defense  is  a  low-margin  business.  It  re¬ 
quires  effective  asset  management.  To 
induce  contractor  investment,  prob¬ 
lems  relevant  to  asset  turnover,  and 
ROI  long-term  must  be  addressed. 

These  problems  include: 

—  Program  instability14 
— Uncertainty 
—  Stretchouts 
—Delays 
—  Indecision 

—  Inconsistent  policy  (decen¬ 
tralized) 

—Excess  regulation 
—Management  layering  with  excess 
requirements  for  recurring  and  multi¬ 
ple  briefings  and  pre-briefings  by  DOD 
line  managers  at  decision  points 
—Fad  government  "initiatives"  not 
always  based  on  full  professional 
thought 

—Annual  budgeting  and  funding 
—Annual  requirements  contracting 
— Excessive  bureaucratic  staffs 
—An  "army"  of  single  interest  ad¬ 
vocates,  and  redundant  auditors  and 
inspectors  general 

— Price-only  competition  and  auc¬ 
tions,  the  "low  bid  focus" 

-Fixed-price  contracts  for  high-risk 
development 

—Technology  transferred  among 
competitors  covertly  in  "parallel 
negotiations,"  or  explicity  by  compul¬ 
sion  after  the  investment  is  committed 
—Transfer  of  risk  and  cost  to  con¬ 
tractors,  small  and  large. 

Tne  DFAIR  includes  much  useful 
analysis  of  investment  behavior  and 
deterrents  to  invest;  e.g.,  Section  111-19 
on  red  tape,  regulation  to  correct  the 
"abuses  of  a  few"  strangling  the 
system,  and  hostility,  all  as  perceived 
by  contractors,  who  make  investment 
decisions  (also,  see  Vl-4). 
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All  those  problems  may  be  difficult 
to  deal  with  but  they  are  reality,  and 
it  is  not  realistic  to  act  as  if  studying 
and  tinkering  with  profit  margins  will 
affect  significant  investment  decisions 
in  that  environment. 

That  is  what  the  company  invest¬ 
ment  decision-maker  sees,  along  with 
what  the  1986  Packard  Commission 
saw,  a  'total  focus"  on  the  "low  bid," 
a  '  police  state  mentality,"  and  an  ac¬ 
quisition  management  system  where 
the  "obvious  requirements  for  a  suc¬ 
cessful  program,"  the  principles  of 
classic,  professional,  decentralized  line 
management,  are  "honored  in  the 
breach.  15 

There  is  evidence  that  these  deter¬ 
rents  to  investment  by  the  company 
manager  affect  investment  by  possible 
stockholders  in  the  company,  and  in 
the  defense  industry  itself.  The  stock 
market  evaluates  a  company  (and  its 
industry)  by  looking  at  annual  earn¬ 
ings  per  share  and  the  stock  price  in 
relation  to  that.  The  price/earnings 
multiple  (stock  price  divided  by  annual 
earnings  per  share)  or  PE  tells  the 
capital  market  view  of  the  investment. 
A  discounted  PE  reflects  a  lack  of 
confidence. 

—  "Trends  appear  to  favor  a  continua¬ 
tion  of  the  industry's  current  20-25% 
price  earnings  valuation  discount  vis- 
a-vis  the  broader  industry  aver¬ 
ages."16  according  to  respected 
analysts. 

—  "...40%  to  60%  discount..."  of  the 
industry  PE.  Fortune  March  16,  1987, 

p.  66. 

That  would  mean  the  company,  or 
firms  comprising  the  mobilization 
base,  is  at  a  competitive  disadvantage 
raising  equity  capital  (cash)  to  invest 
in  competing. 

It  appears  these  deterrents  to  ROI 
justification  for  defense  business  in¬ 
vestment  have  an  impact  that  over¬ 
whelms  profit  policy  changes, 
weightings,  and  debates  among  the 
GAO,  DOD  and  others;  in  the  main, 
they  deal  with  profit  margin,  or  talk 
about  ROI  without  consideration  of 
the  need  for  effective  asset  manage¬ 
ment  and  utilization. 


Recommendation-Reality 

A  more  rational  approach  would  be: 

—  Recognize  the  overwhelming  asset 
management  or  S/TA  problems. 

—  Do  what  we  can  about  them: 

As  described  in  AFSC  "Affordable 
Acquisition"  Study  1983. 

— Program  and  funding  stability  is 
much  of  the  answer.  Note:  Stability  is 
essential  to  achievement  of  learning 
and  experience-curve  effect. 

— Learning  and  experience-curve 
effects  are  critical  to: 

— Effective  asset  management, 
or  S/TA 

—Unit  cost  reduction 
— Quality 
—Corporate  health 

—  Centralize  control  of  profit  and 
other  policy  in  OSD. 

—Proceed  with  the  Packard  Com¬ 
mission  1986  "Formula  for  Action" 
recommendations — classic,  decen¬ 
tralized,  professional  line  manage¬ 
ment.  Incidentally,  decentralized 
management  of  execution  of  programs 
requires  central  control  of  policy. 

—Reinvigorate  the  1981  Carlucci 
Initiatives,  including  Recommendation 
1,  Decentralized  Management. 

—Put  in  place,  or  recognize,  con¬ 
tracting  officers  with  education,  ex¬ 
perience  and  authority,  and  go  back  to 
reliance  on  their  informed  good 
business  judgment.  Provide  them,  to 
consider  but  not  to  be  bound  by,  quan¬ 
tified  guidance  on  profit  such  as  that 
in  DOD  FAR  Supplement  Part  15. 

—Punish  and  deter  wrongdoing, 
but  don’t  try  to  prevent  all  wrong¬ 
doing  at  any  cost. 

—Provide  broad  defense  industry 
profitability  data  for  the  information 
of  program  managers  and  contracting 
officers  on  which  to  develop  their  ac¬ 
quisition  and  contracting  strategies, 
and  their  sound  business  judgment. 
Such  industry  data  might  be: 

—  After  tax  net  income  (after  tax 
and  all  costs,  not  just  allowable  costs). 

—Net  income  divided  by  sales,  or 
profit  margin. 

—Net  income  divided  by  total 
assets,  or  ROA  or  ROI. 


—Sales  divided  by  total  assets,  or 
asset  turnover,  the  measure  of  effi¬ 
ciency  (to  be  achieved  by  effective 
company  management,  to  the  extent 
permitted  by  defense  acquisition  policy 
and  practice  and  the  actions  of  pro¬ 
gram  managers  and  contracting 
officers). 

— Net  income  plus  depreciation,  or 
cash  flow,  divided  by  total  assets,  or 
cash  flow  return  on  assets.  Cash  flow 
over  time  indicates  the  real  health  of 
the  company  (or  the  industrial 
mobilization  base). 

— Debt  to  capital  ratios,  which 
help  indicate  corporate  health. 

— Financial  liquidity  ratios,  which 
help  indicate  corporate  health. 

— Stock  market  price — earnings 
ratios,  compared  to  broad  market, 
which  indicate  corporate  and  mobiliza¬ 
tion  base  health  in  the  capital  market 
where  companies  seek  cash  by  selling 
stock  or  borrowing. 

—Capital  investment  (maybe  as  a 
percentage  of  sales  and  of  cash  flow). 
How  much  of  the  cash  flow  is  being 
reinvested  long-term?  What  is  hap¬ 
pening,  as  a  matter  of  fact,  should  in¬ 
dicate  whether  there  are  incentives  to 
investment  that  are  working  over  time 
in  the  national  interest.  Capital  invest¬ 
ment  should  not  be  an  end  in  itself,  or 
a  favored  investment. 

—  Investment  in  independent 
research  and  development.  This  could 
be  one  indicator  of  the  future  health  of 
the  industrial  base,  and  of  its  weapons 
technology  competitive  edge  vis-a-vis 
the  Soviets. 

— There  probably  should  not  be  an  at¬ 
tempt  to  say  what  is  an  acceptable 
level  of  profitability  (ROI).  At  best,  it 
could  only  be  a  range,  given  the  varie¬ 
ty  of  risks,  strengths,  and  business 
portfolio  characteristics  of  the  defense 
companies.  The  ultimate  question 
would  be  whether  over  time,  the  well- 
managed  defense  companies  or  effec¬ 
tive  competitors  are  meeting  their  cost 
of  capital  requirements,  by  their  ability 
to  attract  equity  investment  (market 
price  performance  of  the  company 
stock)  and  debt  capital  (credit  ratings 
and  terms  of  available  credit  lines).  If 
a  company  is  doing  particularly  well, 
that  may  be  acceptable  if  it  is  an  effec¬ 
tive  competitor  delivering  high  quality 
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and  low  total  cost  to  the  government. 
Ask  whether  it  is  continuing  to  invest 
and  compete.  What  happens  over  time 
is  relevant.  Annual  comparisons  of  one 
financial  accounting  measure  of  prof¬ 
it  or  another  to  non-defense  industry 
are  not  relevant. 

—  Make  sure  effective  competitors  and 
low-cost  producers  have  a  fair  chance 
to  win  and  keep  winning.  Don't  favor 
them,  but  don't  stack  the  deck  against 
them,  as  in  the  parallel  negotiations 
"best  and  final”  auctions  and  forced 
transfer  of  technology  to  competitors. 

—  Leave  investment  decisions  to 
well-managed  companies  and  their 
managers. 

Finally,  let  the  acquisition  system 
and  the  people  in  it  work  and  find  the 
satisfaction  of  effective  service  to  the 
nation.  Stop  the  flood  of  procurement 
"initiatives."  Where  an  "initiative"  is 
necessary,  see  that  it  is  thought  out  in 
advance  by  competent  professionals. 
Given  the  volume  and  complexity  of 
business  done  in  defense  acquisition, 
there  will  be  mistakes  and  wrong¬ 
doing.  As  to  fraud,  we  should  rely 
more  on  deterrence.  Prevention  of  all 
mistakes  and  wrongdoing  is  impossi¬ 
ble.  and  efforts  to  prevent  at  any  cost 
a  recurrence  of  the  problem  of  the  mo¬ 
ment  can  be  stifling  and  demoralizing 
to  the  reliable  people  in  the  work  force. 
That  means  the  leaders  must  stand  up 
to  criticism.  The  work  force  deserves 
that. 
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he  objectives  of  this 
article  are  to  ex¬ 
amine  the  environment  in 
which  scientists  and  engi¬ 
neers  operate  most  effective¬ 
ly  and  to  identify  leadership 
and  administrative  skills  ap¬ 
propriate  to  creating  that  en¬ 
vironment.  The  research 
method  consists  of  gathering 
information  from  books  and 
journals  written  by  experts 
in  the  technical  environ- 


I  examine  management  theories  and  opinions  of  experts 
and  compare  their  findings  with  my  personal  experiences 
and  observations.  The  end-product  represents  the  value- 
added  approach  to  leadership  and  administration  in  the 
technical  environment,  which  consists  of  unique  attributes 
and  other  factors  contributing  to  leadership  effectiveness. 
Transitioning  from  a  technical  professional  to  an  effective 
technical  manager  requires  understanding  the  following: 

-Unique  problems  associated  with  leadership  and  ad¬ 
ministration  exist  in  a  technical  environment. 

Skills  and  techniques  to  achieve  effective  leadership  need 
to  be  identified. 

Current  findings  and  merits  of  the  Situational  Leadership 
Theory  can  be  applied. 

Complexity  of  human  behavior  in  organizations  must  be 
understood . 
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Technical  Environment 


It  appears  leadership 
alone,  without  other  man¬ 
agement  skills,  can  partially 
accomplish  organizational 
effectiveness.  The  degree  of 
effectiveness  is  a  function  of 
variables  which  behaviorists 
have  not  addressed  ade¬ 
quately.  It  appears  a  proper 
mixture  of  personality  traits 
and  management  skills  are 
desirable  in  the  successful 
development  of  effective 
leadership  and  the  quest  for 
the  ideal  manager-leader. 


Types  of  environment  influence  motivation,  performance 
and  job  satisfaction.  Effective  organizations  create  favorable 
environments  for  their  human  resources  to  achieve  high  pro¬ 
ductivity  and  job  satisfaction. 

Why  Engineers  and  Scientists  Often  Fail  as  Managers 

t>aird  addressed  the  real-world  environment  of  technical 
management  by  telling  managers  how  to  manage  people  and 
make  decisions.1  He  has  practical  management  experience 
and  believes  engineers  and  scientists  are  rarely  trained  for 
management  and  that  competence  in  management  can  be 
learned. 

Owen  C.  Gadeken,  Director  of  the  Education  Research 
Team  .it  the  Defense  System  Management  College,  wrote 
a  research  paper  and  formulated  the  following 

conclusions:2 
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-  According  to  AT  *c  I  management 
assessment  surveys.  engineers  are  less 
prepared  than  others  tor  middle 
management .  The  assessments  were 
based  on  management  skills  and 
abilities  possessed  by  three  categories 
ot  college  majors.  The  humanities  and 
soual  sciences  group  rated  at  4o  per¬ 
cent  potential,  business  majors  at  31 
percent  and  engineers  at  only  2o  per¬ 
cent.  These  statistics  have  been  verified 
by  A  I  ic  T  as  quite  accurate  and  con¬ 
firmed  by  empirical  data. 

According  to  Pelz  and  Andrews, 
scientists  and  engineers  performed  best 
when  conditions  leading  to  security  (in 
their  environment'  coexisted  with  fac¬ 
tors  creating  challe*  •  e.3 

Current  research  on  managerial  ef¬ 
fectiveness  supports  a  situational  or 
contingency  theory  ot  management. 

-  Most  people  could  be  trained  and 
issume  leadership  and  managerial 
positions. 

-  The  most  important  skills  for 
engineering  management  are  interper¬ 
sonal  communication,  team  building, 
and  conflict  management. 

Gjcleken  s  data  indicated  that  mov¬ 
ing  from  technical  specialist  to 
manager  may  not  be  an  easy  transi¬ 
tion,  He  quoted  a  management  train¬ 
ing  authority,  Dr.  Richard  Boyatzis. 
by  stating  that  "It  is  usually  not  the 
lack  of  knowledge,  but  the  inability  to 
use  knowledge  that  limits  effective 
managerial  behavior,"  Recognizing 
that  feedback  is  needed  to  learn  and 
reinforce  management  skills,  the 
Defense  Systems  Management  College 
at  hurt  Belvoir.  Va..  has  made  changes 
in  its  curriculum  to  provide  simula¬ 
tions  designed  to  recreate  the  multiple 
problems  and  complex  interactions 
charac  terizing  the  managerial  environ¬ 
ment  I  believe  simulation  ot  manage¬ 
ment  concepts  and  applications  using 
computers  artificial  intelligence  and 
expert  systems  will  provide  break¬ 
throughs  in  training  managers. 

It  is  clear  that  leadership  and  ad¬ 
ministration  in  a  technical  environ¬ 
ment  is  different  than  in  other  en¬ 
vironments  such  as  production, 
wholesale-retail,  and  the  military 
Stills  identified  by  (iadeken  are  ex¬ 
tremely  important  in  a  creative  at¬ 
mosphere.  1  can  confirm  from  mv  ex- 
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periences  that  these  skills,  phis  the 
ability  to  manage  change  are 
necessary  tor  success  in  dynamic  and 
changing  technical  environments. 

Skill  Requirements  for 
Engineering  Managers 

Specific  skills  needed  to  manage  ef¬ 
fectively  in  today’s  demanding 
engineering  environment  were  in¬ 
vestigated  by  H.  T.  Thamhain.  His 
paper  examines  the  association  be¬ 
tween  skill-level  and  managerial  per¬ 
formances,  and  sources  for  potential 
skill  development. 

Thamhain's  paper  focuses  on  the 
process  of  and  criteria  for  identifying 
and  developing  eng.neering  manage¬ 
ment  skills,  considering  their  actual  ef¬ 
fectiveness  and  success  in  leading 
engineering  organizations.4  Thamhain 
stated  that  specific  skills  necessary  to 
manage  effectively  in  an  engineering 
environment  can  be  categorized  as 
leadership,  technical,  and  admin¬ 
istrative  skills.  Furthermore,  manage¬ 
rial  skills  can  be  learned  by  experi¬ 
mental  on-the-job-training  through 
professional  seminars  and  formal 
schooling.  He  stated  that  "the  engineer¬ 
ing  manager  must  be  a  social  architect 
who  understands  his  organization,  its 
culture  and  value  system,  its  environ¬ 
ment,  and  its  technology.  The  days  of 
the  manager  who  gets  by  with  tech¬ 
nical  expertise  alone  or  pure  adminis¬ 
trative  skills  are  gone."  In  general,  the 
skills  needed  to  be  an  effective 
manager  are  not  normally  found  in 
engineering  types. 

Hersey  and  Blanchard  said  some 
organizations  believe  that  the  desirable 
executive  is  dynamic,  imaginative, 
decisive,  and  peisuasive.-  I  believe 
these  general  attributes  do  not  ade¬ 
quately  describe  the  skills  and  abilities 
needed  tor  the  technical  environment. 
IVorlman.  who  had  practical  ex¬ 
perience  as  ,)  technic  al  manager  and  as 
a  management  consultant  when  1  met 
him  in  1 ’ale'  Alto,  (.alit  .  has  identil ied 
some  spec,  it ic  skills  needed  in  technical 
management.'’ 

Communications 

Conflict  Resolution 

Mot  Ration  1’roduc  tivity 

Interpersonal 


Intergroup 
Intragroup . 

IVorlman,  a  former  assistant  to  a 
vice-president  in  a  Fortune  500  com¬ 
pany,  was  suddenly  assigned  the 
responsibility  to  manage  more  than 
100  people.  He  concluded  that  Peo¬ 
ple  are  intensely  complex.  People 
problems  are  among  the  most  common 
causes  ot  mismanagement  and  project 
failures.’  His  unique  experience 
prompted  him  to  write  the  book.  Ef¬ 
fective  Management  tor  Scientists  aiu! 

Engineers. 

Leadership  Transition  from 
Engineering  to  Management 

IV.  F.  Peck,  technical  management 
consultant,  provided  test  data  regard¬ 
ing  the  personality-interest  profile  of 
the  scientific  personality,7  The  follow¬ 
ing  is  a  summarized  description  ot  the 
profile  based  on  written  tests  given  to 
technical  professionals: 

—  High  analytical  interests 
—Conservative 

—  Dependent  on  facts 

—  low  trust  in  support  from  others 

—  Zero  detect,  detail  oriented 

—  Individual  thinker  and  doer 

—  Reactive  orientation, 

Peck  argued  most  engineer-man¬ 
agers  failed  to  transition  from  technical 
competence  into  management  com¬ 
petence  because  they  lacked  an 
understanding  of  group  behavior.  The 
following  characteristics  may  explain 
why  the  transition  can  he  difficult 
without  training  and  conscientious  ef¬ 
fort  of  the  technical  professional  to 
become  a  team  builder: 

Contributor 

—  Individual  Thinker 

—  Decisive-Unyielding 
— Task  Oriented 

—  Self  Dependent 

—  Autocratic  Style 

Team  Leader 

— Group  Discussion  Analysis 
Ability  to  Gain  Consensus 
Goal  Oriented 

—  Group  Interdependent 

—  Democratic  Style. 

According  to  Peck,  two  specitic 
changes  must  take  place  as  a  scientist 
develops  into  a  professional  manager. 
First,  the  leader  s  relationship  with  the 
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product  or  service  must  change  from 
direct  to  imiircct  involvement.  The 
leader  who  has  performed  so  we!! 
dealing  directly  with  projects  and 
technical  problems  must  now  learn  to 
deal  indirectly.  The  orientation 
changes  from  solving  and  controlling 
technical  problems  to  leading  and 
teaching  others  to  solve  technical  prob¬ 
lems.  and  dealing  directly  with  pro¬ 
jects.  Second,  most  professionals  en¬ 
joy  the  informal  atmosphere  of  a  small 
group  and  lack  the  commitment  to 
become  better  professional  managers. 
As  the  organization  grows,  its  leaders 
must  recognize  and  support  the  un¬ 
popular  position  that  more  formal 
policies  and  procedures  arc  necessary. 

Real  World  Environment 

The  technical  environment  is  a  com¬ 
plex  organization  where  professionals 
are  highly  educated,  with  definite  per¬ 
sonalities.  and  specialized  skills.  It  is 
an  environment  where  the  specialized 
knowledge  of  a  junior  engineer  can  at 
times  have  expert  power,  and  influence 
colleagues  and  the  manager-leader. 
The  technical  environment,  as  ob¬ 
served  by  me,  is  situational  because  its 
demands  by  people  and  tasks  require 
different  management  styles  at  dif¬ 
ferent  stages.  Is  it  any  wonder  man¬ 
aging  becomes  more  difficult  because 
of  rapid  changes  and  constant  conflicts 
unique  in  technical  environments?  It  is 
apparent  that  legal  or  organizational 
power  does  not  lend  itself  to  dynamic 
and  creative  environments. 

A  leader-manager  must  recognize 
there  is  no  absolute  power  and  that  the 
best  approach  is  using  personal  power 
and  participative  management  style  to 
influence  subordinates  to  produce  at 
peak  efficiency,  and  to  motivate  and 
keep  employees  satisfied  enough  to 
stay  with  the  company.  In  my  opinion, 
mismanagement  has  added  to  prob¬ 
lems  of  employee  absenteeism,  turn¬ 
over.  and  mental  health.  Unfortunate¬ 
ly,  L'.S.  corporations  are  too  busy 
worrying  about  short-term  goals  and 
who  is  continually  involved  with  reac¬ 
tive  management.  There  are  not 
enough  good  managers  to  pay  ade¬ 
quate  attention  to  the  intervening 
variables  and  strategic  planning.8  The 
intervening  variables  represent  the  in¬ 
ternal  state  of  the  organization  which 
are  influenced  by  organizationa  I 
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leadership  strategies  and  styles, 
management  decisions,  company 
philosophies,  objectives,  policies,  and 
structure.  Strategic  planning  reflects 
the  organization's  mission,  long-term 
objectives  and  goals,  and  compatibili¬ 
ty  with  the  demands  of  the  environ¬ 
ment  (internal  and  external). 

What  is  an  ideal  environment?  Chris 
Argvris,  behaviorist,  challenges 
management  to  provide  a  w'ork 
climate  in  which  everyone  has  a  chance 
to  grow  and  mature  as  individuals  and 
as  members  of  a  group  by  satisfying 
their  own  needs,  while  working  for  the 
success  of  the  organization.11 


loader-manager 
must  recognize 
there  is  no  ab¬ 
solute  power  and 
that  the  best  ap¬ 
proach  is  using 
personal  power  and 
participative 
management  style 
to  influence  subor¬ 
dinates  to  produce 
at  peak  efficiency, 
and  to  motivate  and 
keep  empl'  ees  satisfied 
enough  to  stay 
with  the  company. 


I  believe  organizational  factors  are 
numerous  and,  at  times,  unpredictable 
and  can  impact  a  manager's  success 
and  effectiveness.  One  of  the  problems 
with  incompetent  management  is  sti¬ 
fling  of  creativity  and  innovation  in 
technical  environments.  Appropriate 
handling  of  environmental  situations 
and  intervening  variables  (which  deter¬ 
mine  the  long-term  effects  on  organiza¬ 
tions)  becomes  an  issue  difficult  to 
teach;  the  conscientious  manager 
should  be  willing  to  learn  from  ex¬ 
periences  and  from  available  tech¬ 
niques  during  the  process  of  managing. 


Leadership  and  Administration 

Leadership  and  administration  con¬ 
cepts  and  theories  have  evolved  dur¬ 
ing  the  years  from  the  classical 
management  style,  scientific  manage¬ 
ment  movement,  human  relations 
movement  and,  now,  the  behavioral 
approach  to  management.  Still, 
mismanagement  is  widespread  in  cor¬ 
porate  America  and  there  exist  ineffec¬ 
tive  solutions  to  overcome  organiza¬ 
tional  problems  caused  by  bad 
managers.  One  would  conclude  that 
management  theories  and  concepts  are 
either  not  appropriate  or  not  being 
used  properly.  Often,  misuse  of 
management  theories  stems  either  from 
the  managers  having  been  inadequate¬ 
ly  trained  or  from  lack  of  genuine  com¬ 
mitment  to  a  positive,  communicative 
managerial  method. 

Boyatzis  said  "It  is  usually  not  the 
lack  of  knowledge,  but  the  inability  to 
use  knowledge  that  limits  effective 
managerial  behavior.”  According  to 
Hersey  and  Blanchard,  society  changes 
make  effective  leadership  in  the  future 
a  more  challenging  task,  requiring 
greater  sensitivity  and  flexibility.  I 
believe  management  of  people  is  a 
complex  and  challenging  process. 
Problems  of  management  are  at¬ 
tributable  to  people,  manager  and 
subordinates.  Therefore,  Peter 
Drucker’s  statement  "Managers 
(business  leaders)  are  the  basic  and 
scarcest  resource  of  any  business  enter¬ 
prise,"  should  be  true  forever. 

Effective  Managerial  Leadership 

According  to  James  Cribbin,  there 
is  more  to  being  a  manager  than 
becoming  a  leader.10  Leadership  is  one 
element  of  the  overall  managerial  job, 
something  many  behavioral  scientists 
have  failed  to  recognize.  Management 
and  administration  are  geared  to  the 
achievement  of  organizational  objec¬ 
tives  but,  at  times  leadership  may  be 
exercised  to  thwart  attainment  of  these 
very  objectives.  Reality  is  that  many 
executives  do  not  have  the  ability  to 
motivate  subordinates.  Some  are  more 
interested  in  achieving  personal  goals 
and  are  engaged  in  demotivating  rather 
than  motivating. 

Note  that  the  manager  is  the  leader 
of  people  when  they  alio w  him  to  in¬ 
fluence  their  thinking,  attitudes  and 
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behavior.  Influence  implies  the 
manager  is  accepted  by  subordinates, 
looked  to  with  respect  for  guidance 
and  direction,  and  perceived  as 
capable  of  helping  satisfy  needs  and 
aims.  At  the  heart  of  the  influencing 
process  is  the  impact  one  human  being 
has  on  others.  It  is  clear  that  a  manager 
making  no  impact  on  subordinates  or 
the  organization  is  not  doing  a  good 
job. 

By  definition,  organizational  leader¬ 
ship  is  the  ability  to  influence  the 
thinking,  attitudes,  and  activities  of 
others  so  they  u'illingly  direct  behavior 
toward  organizational  objectives. 
Cribbin  claims  there  are  four  major 
dimensions  of  managerial  leadership: 

—  Personality  of  manager-leader  (as 
perceived  by  followers) 

—  Personality  of  group  (as  perceived 
by  leader) 

—  The  Situation:  Manager  must  ac¬ 
commodate  leadership  actions  to  the 
situation,  and  not  expect  situations  to 
meet  preconceptions 
—Organizational  Factors:  Manager 
must  be  sensitive  to  environment 
(politics,  power  groups,  top-man¬ 
agement  beliefs,  associates,  superiors, 
followers,  and  situational  variables). 

Cribbin,  professor  of  management, 
St.  John's  University,  England,  argued 
that  a  manager  must  recognize  that  the 
legal  right  to  manage  others  does  not 
qualify  the  manager  to  lead.  The  leader 
must  earn  a  psychological  and 
sociological  right  to  do  so  because  in- 
tluence  is  merited  and  gained,  not 
coerced  and  demanded.  The  manager 
must  build  a  relationship  based  on 
mutual  trust,  respect,  and  considera¬ 
tion. 


Leadership  and 
Motivation  Research 

The  concept  of  situational  leadership 
is  the  outgrowth  of  the  Michigan 
University  and  Ohio  State  leadership 
studies,  which  provide  the  basis  for 
Blake  and  Mouton  to  develop  the  two- 
dimensional  leadership  model  called 
the  Managerial  Grid.  Subsequently, 
Fred  E.  Fiedler  developed  the  Con¬ 
tingency  Leadership  Theory:  Hersey 
and  Blanchard  developed  the  Tri- 
Dimensional  Situational  Leadership 
model , 
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Michael  VVellin  argued  that 
behavioral  technology  (BT)  differs 
from  the  conventional  methods  and 
approaches  in  the  applied  behavioral 
sciences.11  In  place  of  elegant  models 
and  theories  about  why  people  behave 
in  particular  ways,  BT  emphasizes  the 
need  to  collect  objective  information 
about  the  way  they  actually  do 
behave.  By  collecting  solid  evidence 
about  what  a  person  is  doing,  we  can 
make  accurate  assessments  and  inter¬ 
pretations  about  factors  determining 
this,  and  then  plan  actions  to  bring 
about  desired  changes  (BT  supports  the 
idea  that  accurate  assessment  of  the 
follower  and  environment  is  the  key 
for  using  the  situational  leadership 
model  effectively).  The  central  concept 
is  the  use  of  transactional  analysis  (TA) 
as  a  framework  for  understanding 
what  people  do.  Wortman  and 
Blanchard  and  others  support  TA  as  a 
useful  technique  in  understanding  peo¬ 
ple's  behavior  better. 

Michigan 

Leadership  Studies 

These  studies  concluded  the 
employee-oriented  leader  accepts  that 
every  employee  is  an  important  in¬ 
dividual  with  personal  goals,  whereas 
the  production-oriented  leader  em¬ 
phasizes  production,  viewing 
employees  as  tools  to  accomplish 
organization  goals.  The  following 
behaviorists  provide  more  supporting 
data  to  the  Michigan  Studies. 

•  Victor  Vroom  and  Floyd  C.  Man 
—Closely-knit  units  prefer  employee- 
centered  supervision. 

—Those  who  work  on  their  own, 
prefer  directive  approaches. 

—  Participative  approach  did  not  help 
productivity  and  attitudes  for  the  less 
independent  needs,  but  it  did  improve 
those  people  who  have  strong  in¬ 
dependence  needs. 

•  Rensis  Likert 

—Concluded  it  is  the  management 
philosophy  permeating  an  organiza¬ 
tion  that  is  crucial,  not  results  ob¬ 
tained  from  studying  lower-level 
supervisors  and  managers.  His  findings 
in  patterns  of  management  indicated 
that: 

-Employee-centered  management 
gives  better  performance. 


—  Job-centered  management  has  low 
productivity. 

—  Moderate  supervision  is  associated 
with  high  productivity. 

— Cribbin  supports  Likert  in  stating 
the  Michigan  and  Ohio  State  Studies 
emphasized  the  wrong  end  of  the 
organizational  structure.  It  would  have 
been  far  better  had  they  studied  those 
at  the  top  of  the  hierarchy  instead  of 
supervisors  who  carry  little  or  no 
clout. 

Ohio  State  Studies 

The  studies  indicated  there  are  two 
orientations  in  leadership: 

—  Initiating  Structure— A  structured 
(well  defined)  pattern  of  organization, 
channels  of  communication,  and 
methods  of  procedure.  The  focus  is  on 
corporate  demands. 

—  Consideration  —  Maintain  trust, 
respect  and  two-way  communication 
between  the  leader  and  staff  members. 
Focus  is  on  participative  management 
and  the  need  of  employees. 

The  Ohio  State  studies  have  the 
following  implications: 

—Employees  desire  consideration  and 
superiors  prefer  structure. 

—Superiors  can  compensate  for  high 
structure  by  increasing  their  considera¬ 
tion  behavior,  but  low  consideration 
cannot  be  compensated  for  by  lower¬ 
ing  structure  (a  confirmation  of 
preference  for  people-oriented  leaders) . 

— Superiors  who  have  high  considera¬ 
tion  can  increase  their  structure  with 
little  increase  in  grievances  (considera¬ 
tion  overcomes  the  negatives  of 
structure). 

Managerial  Grid 

The  Blake  and  Mouton  leadership 
model  attempts  to  categorize  the 
leadership  styles  by  creating  four 
quadrants  of  behavior  for  leaders. 
They  were  determined  on  the  basis  of 
degrees  (high/low)  of  concern  for 
either  production  or  people.  The 
model  was  used  worldwide  mainly 
because,  for  the  first  time,  theories  and 
behavioral  patterns  identified  by 
Michigan  University  and  Ohio  State 
were  translated  into  a  model  managers 
understand.  The  problem  is  this  theory 
is  an  either/or  situation.  It  does  not 
provide  for  a  range  of  behaviors  ap- 
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propriate  to  the  situation.  The  model 
does  support  the  idea  of  participative 
management  style  and  that  high  con¬ 
cern  for  people  and  production  is  the 
best  style. 

Contingency  Leadership  Theory 

Fred  E.  Fiedler  concluded  there  are 
three  variables  significant  for  leader¬ 
ship  effectiveness: 

—  Leader-Member  Relations— there 
must  be  acceptance  and  trust. 

—Task  Structure— the  degree  to  which 
a  given  task  can  be  done  by  the 
members. 

—  Position  Power — the  degree  the 
position  enables  the  leader  to  get  the 
group  to  comply  to  his  direction  (This 
is  reward  and  punishment  power). 

These  factors  interact  with  the  group 
leader's  knowledge  to  define 
favorableness  of  the  situation.  It  is  in¬ 
teresting  that  Fiedler's  theory  allows 
modification  of  situations  to  fit  the 
leadership  and  is  often  applied  in  the 
real  world  because  task-oriented 
(directive)  managers  and  human 
relations-oriented  (non-directive) 
managers  can  be  successful  in  certain 
conditions.  The  caveat  is  that 
managers  should  relate  their  actions  to 
Rensis  Likert's  Theory  on  Organiza¬ 
tional  Effectiveness  where  he  identified 
three  variables  (casual,  intervening, 
and  output)  which  are  interrelated  and 
affected  by  management/leadership 
actions.  The  effective  manager  should 
be  sensitive  to  short-term  achievement 
and  to  the  long-term  impact  of  in¬ 
tervening  variables  affected  by  casual 
variables,  leadership  strategies, 
management  decisions,  organizational 
objectives,  and  policies. 

Situational  Leadership  Model 

Hersey  and  Blanchard,  using  the 
Managerial  Grid  concept,  further  im¬ 
prove  it  to  account  for  the  maturity 
(competence  and  motivation)  level  of 
the  followers.  Their  theory  is  based  on 
the  leader's  behavior,  the  degree  of 
task,  or  relations  orientation.  The 
leader  decides  on  an  approach  by 
knowing  the  situation  relating  to  the 
task  at  hand.  Success  of  this  model 
depends  on  the  leader  to  diagnose  cor¬ 
rectly  the  follower's  competence  and 
commitment  to  accomplish  each  goal . 
To  motivate  people  effectively. 


management  must  use  appropriate 
leadership  styles  in  working  with  dif¬ 
fering  people.  The  situation  is  a  func¬ 
tion  of  the  follower's  maturity,  com¬ 
petence,  and  motivational  levels.  The 
major  difference  of  their  theory  is  that 
it  provides  for  changing  the  leadership 
style  as  the  follower  increases  in 
maturity  (therefore  needs  less  task 
orientation).  Situational  leadership 
(Figure  1)  focuses  on  appropriateness 
or  effectiveness  of  leadership  styles  ac¬ 
cording  to  the  task-relevant  maturity 
of  the  followers. 

Rensis  Likert's  Management 
Systems  Theory 

—System  1  (Exploitative) — Task  ori¬ 
ented,  highly-structured  authoritarian 
management  style. 

—System  2  ( Benevolent  (-Manager  still 
makes  decisions,  but  employees  have 
some  degree  of  freedom  in  performing 
their  jobs. 


—System  3  (Consultative)— Manager 
consults  with  employees  before 
establishing  goals  and  making 
decisions. 

— System  4  (Participative) — Relation- 
ship-oriented  management  style  based 
on  team  work,  mutual  trust  and 
confidence. 

Likert  believes  System  4  is  the  most 
productive  style  of  management.  It  has 
the  following  characteristics: 

—  Leadership 
— Motivation 
— Communications 
— Decision-making 
— Interaction  and  Influence 
— Goal  Setting 
— Control  Process. 

These  attributes,  in  my  opinion,  are 
appropriate  and  definitely  represent 
minimum  requirements  for  a  manager- 
leader  to  achieve  organizational  effec¬ 
tiveness  in  a  technical  environment. 


r 


Implications  and  Observations 

The  following  represent  observa¬ 
tions  and  opinions  as  a  result  of  the 
literature  search. 


— Leadership  can  be  counter  pro¬ 
ductive  if  it  is  directed  toward  per¬ 
sonal  goals,  thereby  disrupting  the 
organization.  The  effective  leader 
knows  leadership  is  the  sharing  of 
credit,  blame,  ideas,  opinions,  and 
experiences.  The  leader  must  en¬ 
sure  that  individual  goals  and 
organizational  goals  are  not  in 
conflict.  Organizational  effec¬ 
tiveness  can  be  accomplished  only 
when  all  goals  are  in  harmony  and 
when  society's  needs  are  satisfied; 
otherwise,  the  organization  will 
eventually  fail. 


—The  profile  of  engineering 
graduates  indicated  they  are 
generally  not  people-oriented. 
Engineering  schools  should  put 
emphasis  on  interpersonal  skills. 
Courses  in  managing,  humanities, 
ethics,  and  value  systems  can  be 
of  great  value  to  prepare  people 
for  management.  Note  that  addi¬ 
tional  demands  are  made  on 
management  because  of  the  in¬ 
creasing  size  and  complexity  of 
organizations,  acceleration  of 
technology,  and  changes  in  the 
demands  of  society  and  em¬ 
ployees. 


—  In  addition  to  management 
skills  needed  in  planning,  organiz¬ 
ing,  influencing  and  controlling, 
the  manager-leader  must  develop 
necessary  skills  to  manage  conflict 
and  change.  Futhermore,  develop¬ 
ment  of  ethics  and  convictions  is 
important  for  accomplishing  long- 
range  organizational  goals  instead 
of  just  personal  goals. 


—The  earlier  leadership  studies  of 
personality  traits  are  useful  in  pro¬ 
viding  answers  to  the  missing  link 
of  why  there  are  few  effective 
managers.  Although  experts 
believe  managerial  skills  can  be 
learned,  training  takes  years  to  im¬ 
plement  and  depends  on  the  quali¬ 
ty  of  instruction  but,  to  a  greater 
degree,  on  willingness  and  com¬ 
mitment  of  the  trainees.  The 
answer  has  to  be  the  lack  of 
positive  personality  traits,  which 
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are  important  to  make  or  break  a 
potentially  effective  manager- 
leader. 

—It  is  generally  accepted  that 
to  change  managerial  styles  is 
difficult  and  time-consuming. 
Fiedler  claimed  it  takes  1-3 
years  of  intense  conditioning  to 
effect  managerial  style  changes. 
Likert  found  it  takes  3-7  years 
to  implement  a  new  manage¬ 
ment  theory  effectively. 
Therefore,  top-management 
commitment  is  required  to 
make  changes  which  will  have 
long-term  effects.  This  fact  may 
explain  why  mismanagement 
continues;  it  is  because  great  ef¬ 
fort  is  required  to  overcome 
resistance  to  personality 
changes. 


/  jt  lthough  experts 
believe  managerial 
skills  can  be  learned, 
training  takes  years 
to  implement  and 
depends  on  the 
quality  of  instruc¬ 
tion  but,  to  a 
greater  degree,  on 
willingness  and 
commitment  of  the 


trainees. 


—Understanding  human  be¬ 
havior  is  crucial  in  management 
and  in  applying  the  Situational 
Leadership  approach.  Mana¬ 
gers  must  have  the  ability  to 
diagnose  the  environment  and 
adapt  their  leadership  styles  to 
meet  demands  of  their  en¬ 
vironments.  Central  to  the  ap¬ 
proach  is  the  consideration  of 
situational  variables  and 
behavior  of  the  leader  in  rela¬ 
tion  to  followers.  The  crucial 
element  in  the  Situational 
Leadership  model  is  that  the 
leader  must  be  able  to  diagnose 
the  environment  and  situational 
variables  correctly. 


Leadership  and 
Organizational  Effectiveness 


Leadership  and  administration  are 
aimed  at  achieving  organizational  ob¬ 
jectives.  Organizational  effectiveness  is 
achieved  by  competent  leadership  and 
application  of  managerial  skills.  These 
skills  are  technical,  conceptual,  and 
human  factors  which  include  the 
manager-leader's  sensitivity  to 
psychological,  sociological  and  an¬ 
thropological  concepts.  Mastering 
these  concepts  and  functions  of 
management  (planning,  organizing,  in¬ 
fluencing,  and  controlling)  increases 
leadership  and  organizational  effec¬ 


tiveness. 


I  believe  it  is  more  important  for  the 
manager  to  make  correct  assessments 
of  the  situation;  understand  what  kind 
of  behavior  and  which  characteristics 
are  likely  to  attract  or  alienate  the 
work  group.  The  theories  should  be 
understood  and  apply  at  appropriate 
situations. 


—Contingency  Theory 

Fiedler's  theory  provides  for  a  range 
in  leadership  behavior,  varying  ac¬ 
cording  to  the  practical  situation  the 
manager  faces.  It  allows  for  a  change 
in  behavior  as  the  favorableness 
changes.  It  is  less  rigid  to  adherence  to 
a  given  approach  regardless  of  cir¬ 
cumstances  of  a  particular  group. 


It  can  be  implied  that  the  control¬ 
ling  and  directive  technique  works  best 
for  either  the  accepted  manager  or  a  re¬ 
jected  manager.  The  reason  is  because 
the  accepted  manager  can  be  forceful 
because  he  is  accepted,  whereas  the  re¬ 
jected  manager  must  be  forceful 
because  he  has  no  alternative  (if  he 
tries  to  be  non-directive,  the  group 
might  abandon  the  task  entirely).  This 
agrees  with  the  finding  that  the  struc¬ 
ture  can  increase  if  consideration  is 
high,  but  lowering  structure  does  no 
good  if  consideration  is  low.  Managers 
who  resort  to  pressure,  power,  and 
punishment  to  get  things  done  are  us¬ 
ing  a  short-term  technique,  which  will 
fail  eventually. 


— Situational  Leadership 

The  Tri-Dimensional  Leadership  Ef¬ 
fectiveness  Model  improves  Fiedler's 
theory  with  a  third  dimension  (effec¬ 
tiveness)  by  allowing  the  combinations 
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of  task  and  relationship  orientation 
along  the  continuum  in  question  (at  a 
particular  situation).  It  is  apparent  that 
the  situational  approach  to  leadership 
was  evolved  from  the  studies  by 
Michigan  University,  Ohio  State 
University,  Fred  Fiedler,  and  Hersey 
and  Blanchard.  Recent  findings  sug¬ 
gested  leadership  is  dynamic  and 
situational. 

The  leadership  process  is  a  function 
of  the  leader,  followers,  and  situational 
variables.  Therefore,  the  leader- 
manager  should  understand  there  is  no 
single,  all-purpose  behavioral  style  ef¬ 
fective  in  all  situations.  Effective 
leadership  behavior,  management 
style,  is  situational.  According  to 
Hersey  and  Blanchard,  the  key  to  ef¬ 
fective  leadership  is  to  identify  the 
maturity  level  of  the  individual  or 
group,  then  bring  to  bear  the  ap¬ 
propriate  leadership  style. 

It  can  be  implied  that  the  behavioral 
approach  requires  continual  adjust¬ 
ment  and  reinforcement  of  behaviors 
between  leader  and  follower;  influen¬ 
cing  power  is  earned  and  that  raw 
power  is  delegated  by  organizational 
structure.  The  effective  manager  has 
proper  attitudes  and  interactions 
toward  subordinates  for  reinforcing 
their  acceptance  and  for  satisfying  ex¬ 
pectations  (accomplishment  of  in¬ 
dividual  goals)  of  the  subordinates. 

— Motivational  Theories 

The  leader  cannot  be  effective 
without  understanding  what  motivates 
people.  The  following  motivational 
theories  provide  a  framework  for  the 
leader  to  incorporate  into  the  manage¬ 
ment  process: 

—  McGregor's  Theory-X  and  Theory- 
Y :  Leader  should  understand  that  it  is 
only  an  attitude  or  assumption  about 
people  (not  the  people's  behavior). 

—  Maslow's  Hierarchy  of  Needs: 
Leader  should  always  determine 
motivational  level  of  people 'followers. 

—  Herzbergs  Motivation-Hygiene 
Theory:  Leader  should  ensure  the  cr. 
vironment  (job  security,  working  con¬ 
ditions.  supervision,  interpersonal 
relations)  are  being  satisfied  and  the 
motivators  (recognition  for  ac¬ 
complishment  and  challenging  work) 
are  present  at  the  work  place. 

Program  Manager 


—  McClelland's  Achievement-Moti¬ 
vation  Theory:  Leader  should  under¬ 
stand  people  like  to  set  goals  that  are 
potentially  achievable.  Therefore,  par¬ 
ticipative  management  and  MBO  are 
effective  techniques. 

—  Berne's  Transactional  Analysis: 
Leader  should  use  this  framework  as 
a  tool  for  understanding  what  people 
do  and,  in  particular,  the  variety  of 
feelings  they  express.  Understanding 
human  nature  helps  the  leader  apply 
the  situational  approach  in  leadership. 

—Management  Traits  Approach 
Ghiselli's  Trait  Approach  to  Leader¬ 
ship  has  identified  the  six  most  signifi¬ 
cant  traits  of  personality  and  motiva¬ 
tion.  I  believe  leaders  should  develop 
or  learn  these  attributes,  which  could 
make  their  job  of  managing  more 
effective: 

—  Supervisory  ability:  Performance  of 
the  basic  functions  of  management  in¬ 
cluding  planning,  organizing,  influenc¬ 
ing,  and  controlling  work  of  others. 

—Need  for  occupational  achievement: 
Seeking  responsibility  and  desire  for 
success. 

— Intelligence:  Creative  and  verbal 
ability  including  judgment,  reasoning, 
and  thinking  capacity. 

—  Decisiveness :  Ability  to  make  deci¬ 
sions  and  solve  problems  capably  and 
competently. 

— Self-assurance:  Extent  to  which  in¬ 
dividual  views  himself  or  herself  as 
capable  of  coping  with  problems. 

—  Initiative:  Ability  to  act  in¬ 
dependently  and  develop  courses  of  ac¬ 
tion  not  readily  apparent  to  other  peo¬ 
ple.  Self-starter — able  to  find  new  or 
innovative  ways  of  doing  things. 

Management  Model 

I  believe  organizational  effectiveness 
can  be  achieved  only  in  an  environ¬ 
ment  that  encourages  creativity,  trust 
and  open  communications.  Effective 
managers  should  use  participative 
management  styles  and  build  relation¬ 
ships  vvith  subordinate^  based  on 
mutual  trust,  respect  and  considera¬ 
tion.  The  manager  must  be  flexible  and 
apply  a  holistic  approach  to  the 
management  process.  First,  the 
manager  must  ensure  the  Herzberg  en- 
vironmental/hygiene  factors  be 


satisfied  in  terms  of  providing  a 
desirable  climate  for  productivity;  sec¬ 
ond,  use  the  Hersey  and  Blanchard 
Situational  Leadership  theory  to 
motivate  subordinates;  third,  to  be  ef¬ 
fective  the  manager  must  understand 
and  apply  the  following  concepts  and 
disciplines. 

—  Integration.  Goal  attainment 
depends  on  individual  goals  (superiors 
and  subordinates)  in  harmony  with 
(not  opposing  to)  organizational  goals. 
The  organization  should  create  a 
climate  in  which  one  of  two  things  oc¬ 
curs:  Individuals  either  perceive  their 
goals  as  being  the  same  as  goals  of  the 
organization,  or  believe  personal  goals 
are  being  met  through  achievement  of 
organizational  goals.  The  effective 
manager  has  the  responsibility  to  unify 
people  through  leadership,  motivation 
and  communications  skills,  behind 
organization  goals  and  strategies. 

— Participation.  Research  data  con¬ 
firms  participative  management 
techniques,  involving  employees  in  the 
decision-making  process,  tend  to  be  ef¬ 
fective  in  our  society.  Therefore,  the 
leader-manager  should  permit  mutual 
establishment  of  goals  and  increase 
subordinate  commitments  to  organiza¬ 
tional  objectives  through  the  use  of 
management  by  objectives  (MBO). 

— Attitude.  Theory- Y,  according  to 
McGregor,  is  an  assumption  that  peo¬ 
ple  are  mature  and  responsible.  Work 
is  as  natural  as  play.  People  can  be  self- 
directed  and  creative  at  work,  if  pro¬ 
perly  motivated.  These  assumptions 
are  not  only  necessary,  but  demanded 
by  employees  in  the  technical  environ¬ 
ment.  Note  that  these  theories  repre¬ 
sent  attitudes  (not  behaviors)  toward 
people,  and  that  Theory-X  attitudes 
have  no  merit  in  creative  environ- 


—  Motivation.  Maslow’s  hierarchy  of 
needs  explains  different  levels  of 
human  needs.  Herzberg's  motivation 
theory  supports  Maslow's  and  pro¬ 
vides  a  framework  that  explains  the 
relationship  of  human  goals  (incen¬ 
tives)  and  needs  (motives)  that  produce 
behavior  in  organization.  Herzberg 
claims  that  the  environmental 
(hygiene)  needs  must  be  satisfied 
before  a  person  can  be  properly 
motivated.  This  conclusion  is  con- 
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firmed  by  Pelz  and  Andrews  that 
"scientists  and  engineers  performed 
best  when  conditions  leading  to  securi¬ 
ty  coexisted  with  factors  creating 
challenge."  Environmental  needs  are 
physiological,  safety,  and  social;  they 
include  company  policy,  supervision, 
working  conditions,  interpersonal  rela¬ 
tionships,  money,  status  and  security. 
Motivational  needs  are  esteem  and 
self-actualization,  they  include 
achievement,  recognition  for  achieve¬ 
ment,  challenging  work,  increased 
responsibility,  growth  and  develop¬ 
ment. 


Conclusions  and 
Recommendations 


— Leadership  Style.  Leadership  is  to  in¬ 
fluence  the  behavior  of  others  to 
achieve  (any)  goals.  Management  is  a 
special  kind  of  leadership  for  achiev¬ 
ing  organizational  goals .  Leadership  is 
dynamic  and  situational;  current 
research  indicated  mat  leaders  must 
adapt  their  style  of  behavior  to  meet 
the  particular  situation  and  the  needs 
of  their  followers.  Effective  leadership 
(L)  is  a  function  (F)  of  the  leader  (!), 
the  follower  (f),  and  situational 
variables  (s).  It  can  be  defined  as  L  =  F 
( 1 , f , s) .  The  key  for  success  is  to 
diagnose  the  environment  correctly 
and  use  the  appropriate  leadership 
style  compatible  with  the  follower's 
maturity  level.  Environmental 
variables  are  the  leader,  followers, 
superiors,  associates,  organization,  job 
demands,  and  other  variables.  Note 
that  no  all-purpose  leader  behavior 
style  is  effective  in  all  situations.  The 
type  of  leader  behavior  needed 
depends  on  the  situation;  therefore, 
leadership  is  situational. 
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The  current  research  data  support 
the  Situational  Leadership  Theory, 
which  addresses  behavioral  patterns 
between  leaders  and  subordinates. 
However,  leadership  effectiveness  is  in¬ 
fluenced  by  top  management,  the 
leader's  superior  and  the  firm's  culture. 
It  is  useless  to  expect  human  relations 
courses  to  improve  supervisors  and 
lower-level  managers  when  their 
superiors  and  the  climate  of  the 
organization  do  not  change.  Further¬ 
more,  the  manager  must  have  many 
other  skills  to  deal  with  in  the  real 
world.  Note  that  leadership  effec¬ 
tiveness  may  or  may  not  be  manage¬ 
ment  effectiveness.  The  degree  of 
management  effectiveness  is  a  function 
of  many  variables.  Leadership  alone, 
without  management  skills,  only  par¬ 
tially  accomplish  organizational  effec¬ 
tiveness.  Mastery  of  the  form  basic 
management  functions  (planning, 
organizing,  influencing,  and  control¬ 
ling)  is  not  enough.  I  believe  the  effec¬ 
tive  manager  should  have  skills  in 
analysis,  coordination,  integration, 
negotiation  and  communication  plus 
the  ability  to  manage  change  in  a 
dynamic  and  technical  environment. 
The  difficulty  in  combining  so  many 
qualities  may  explain  why  mismanage¬ 
ment  is  prevalent  and  consistently 
erodes  our  ability  to  compete  in  world 
markets. 


— Management  Style.  Many  skills  are 
needed  to  be  effective,  and  the  most 
important  skills  in  the  technical  en¬ 
vironment  are  technical  skills  for  inter¬ 
facing  with  technical  people;  leader¬ 
ship  and  motivational  skills  for  team 
building;  communication  skills  for 
coordinating  ideas  and  concepts  ver¬ 
bally  and  in  written  form;  integration 
skills  for  unifying  of  strategies,  goals, 
and  concepts.  It  is  apparent  that  the 
management  process  is  complex  and 
demanding;  therefore,  many  skills  and 
abilities  are  required  to  manage  in  a 
technical  environment.  These  realities 
suggest  that  the  technical  manager 
must  be  flexible,  able  to  manage 
change,  and  able  to  use  a  holistic  ap¬ 
proach  in  managing, 


The  theorist  claimed  that  manage¬ 
ment  skills  are  learnable;  why  then,  do 
we  have  so  many  deficiencies  in 
management?  In  my  opinion,  per¬ 
sonality  traits  play  a  more  important 
role  in  managing  than  the  theorist  can 
hope  to  quantify.  Personality  at¬ 
tributes  such  as  judgment,  courage, 
motivation,  integrity,  fairness,  intelli¬ 
gence,  ethics,  creativity,  decisiveness, 
flexibility,  influence  and  compassion 
represent  some  of  the  most  sought- 
after  traits  in  a  manager.  It  is  apparent 
these  attributes  are  important  factors 
affecting  the  leader's  power  base  and 
influence.  It  is  fair  to  say  that  most 
people  in  management  positions  lack 
many  of  these  attributes. 


There  exist  significant  factors  which 
directly  influence  organizational  effec¬ 
tiveness.  These  factors  are  organiza¬ 
tional  structure,  top  management 
philosophy,  company  focus  and 
politics.  The  successful  manager 
understands  human  resources  and  in¬ 
teractions  and  the  use  of  positive 
power  to  accomplish  organizational 
goals.  The  degree  of  success  will  de¬ 
pend  on  the  manager's  technical,  peo¬ 
ple,  and  conceptual  skills  to  overcome 
a  host  of  problems  existing  in  the 
technical  environment,  where  ability 
to  manage  change  is  a  critical  require¬ 
ment.  According  to  Cribbin,  "There  is 
much  more  to  being  a  manager  than 
becoming  a  leader.  Leadership  is  but 
one  element  of  the  overall  management 
job.”  Baird,  Wortman,  and  I  can  con¬ 
firm  the  fact  that  managing  involves 
many  other  skills  that  must  be  brought 
to  bear  in  the  technical  environment. 


I  believe  behaviorists  do  not  have 
complete  answers  to  the  problem  of 
mismanagement.  The  personality  and 
appropriate  skills  must  exist  to  hope 
for  and  develop  an  effective  manager- 
leader.  There  might  be  hope  over  the 
horizon  due  to  technology  advances  in 
artificial  intelligence  and  expert 
systems.  They  will  provide  excellent 
management  simulation  training 
systems  by  providing  repetition,  prac¬ 
tice,  and  reinforcement  of  skills  and 
habits  (which  cannot  be  altered 
without  serious  and  concentrated  ef¬ 
forts).  Learning  technologies  of  the 
future  will  replace  existing  manage¬ 
ment  training  approaches  efficiently 
and  effectively. 

To  achieve  organizational  effec¬ 
tiveness,  the  manager  must  be  flexible 
and  use  a  holistic  approach  in  manage¬ 
ment.  It  is  apparent  understanding 
management  science  is  only  part  of  the 
answer;  an  effective  manager  must  be 
the  catalyst,  who  can  make  an  impact 
on  the  organization,  and  be  an  im¬ 
plementor  of  ideas  and  changes  to 
achieve  organizational  effectiveness. 
One  important  task  for  the  manager  is 
to  ensure  that  individual  goals  are 
compatible  with  organization  goals.  It 
is  the  duty  of  the  leader  to  com¬ 
municate  and  influence  the  people 
above,  around,  and  below  to  ensure 
the  organization  is  moving  in  one 
direction. 


1  conclude  neither  management 
theories  nor  leadership  alone  can  make 
an  effective  manager.  This  has  been 
confirmed  by  the  abundance  of  train¬ 
ing  programs  and  endless  problems 
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created  by  mismanagement.  Nor  does 
experience  mean  that  a  person  can,  or 
has,  become  a  good  manager.  Ten 
years  of  experience  is  worthless  if 
based  on  one  year  of  substandard  ex¬ 
perience  repeated  ten  times.  A  person 
cannot  acquire  effective  leadership  at¬ 
tributes  and  management  know-how 
without  first  having  the  capacity  (in¬ 
tellect)  to  learn  and  the  proper  at¬ 
titudes  (commitment).  The  "commit¬ 
ment"  is  a  personality  trait  separating 
the  successful  from  the  unsuccessful. 

Obviously,  many  managers  rely  on 
raw  power  and  show  little  interest  in 
developing  effective  management 
techniques.  They  view  learning  these 
skills  as  a  monumental  task,  especial¬ 
ly  since  it  involves  understanding 
themselves  and  modifying  their 
behavior. 

At  this  point,  the  personality  trait 
approach  to  leadership  makes  sense 
and  begins  to  separate  the  manager- 
leader  from  the  ineffective  manager.  I 
believe  a  proper  mixture  of  personali¬ 
ty  traits  and  management  skills  are 
desirable  in  the  succcessful  develop¬ 
ment  of  effective  leadership  and  the 
quest  for  the  ideal  manager-leader. 
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compete  because  duplicative  tooling 
would  be  too  costly. 

What  is  it?  It's  what  a  program 
could  cost  if  we,  the  government  and 
contractor  together,  eliminate  the  non¬ 
value  added  work,  or  waste,  done  by 
the  contractor  and  ourselves.  This 
waste  unwittingly  may  be  required 
because  of  regulations  driving  up  con¬ 
tractor  overhead.  It  also  bears  on  what 
the  program  could  cost  if  the  plant 
were  being  operated  efficiently. 

"Could  cost"  does  not  replace  com¬ 
petition  and  also  can  be  used  in  com¬ 
petitive  situations.  It  is  different  from 
"should  cost,"  which  is  based  on 
lessons  learned  and  other  historical  fac¬ 
tors.  It  can  be  used  at  any  point  in  the 
acquisition  process,  but  is  best  if  intro¬ 
duced  early  so  advantages  accrue  all 
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along.  It  means  looking  at  every¬ 
thing— type  of  contract,  number  of 
audits,  contractual  organizational 
structure,  required  documentation, 
quality  systems,  every  aspect  of 
business.  Contractors  with  whom  I 
have  discussed  this  tell  me  it's  possible 
to  reduce  costs  a  minimum  of  25-30 
percent,  and  that's  significant. 

Since  government  has  the  leverage, 
advantages  to  the  government  are 
obvious.  But  what  about  the  contrac¬ 
tor?  It's  like  this — a  forced  streamlin¬ 
ing  and  belt  tightening.  By  playing 
"could  cost,"  his  competitive  position 
will  be  enhanced.  In  these  days  of 
fewer  defense  dollars,  he  needs  every 
advantage.  What  better  incentive? 

The  big  items  I  have  mentioned  are 
extremely  important  to  us,  and  we  are 


working  hard  on  them.  The  ultimate 
requirement  is  cultural  change. 
Outstanding  leadership  and  manage¬ 
ment  are  mandatory  if  we  are  to  make 
it  happen. 

I  earnestly  encourage  your  participa¬ 
tion.  Spread  the  word. 


Dr.  Costello  was  on  the  DSMC  Campus 
in  December.  These  remarks  are  excerpts 
from  his  graduation  address  to  the  Systems 
Acquisition  Management  Course  for  Senior 
Officials. 
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o  one  can  say  the 
!  life  of  a  program 
manager  is  without  its  ups 
and  downs.  You're  a  suc¬ 
cessful  program  manager  in 
your  company.  Your  multi¬ 
million  dollar  program  is 
ahead  of  schedule,  well 
within  cost,  and  meeting  all 
of  its  technical  goals.  After 
months  spent  building  a 
team  and  getting  the  design 
off  the  ground,  you've 
reached  the  point  where  you 
finally  have  a  little  spare 
time  on  your  hands.  It 
wasn't  easy,  but  you  kept  ahead  of  things,  paid  attention 
to  small  problems  and  never  let  them  become  big  ones.  Every 
time  you  pass  the  water  cooler,  the  office  wags  are  talking 
about  Program  B  which  is  in  real  trouble  But  you're  en¬ 
joying  your  moment  in  the  sun  so  you  don't  pause  to  ask 
what  "real"  trouble  means.  After  all,  you're  riding  the  crest 
of  success  and  the  existence  of  a  troubled  program  is  not 
your  concern. 

Then  comes  the  unexpected  call  from  your  boss.  He  wants 
to  see  you  first  thing  in  the  morning.  You  can't  imagine  what 
he  wants  to  talk  about  since  your  program  is  in  such  good 
shape.  When  you  get  to  his  office,  he  starts  the  meeting  by 
telling  you  how  much  your  program's  success  means  to  the 
company  So  far  so  good.  Next  comes  the  discussion  about 
Program  f.  He  tells  you  that  "we  all  know"  that  it  really 
needs  help  and  he  believes  that  you're  the  person  to  step 
in  and  get  this  mess  squared  away.  You  come  out  of  your 
boss's  office  in  a  slight  daze,  saying  to  yourself,  "What  did 

I  rip  In  (fpcprve  this7" 

But  wait.  Don't  despair.  You  just  might  be  in  for  the 
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most  fun  you've  ever  had 
as  a  program  manager; 
meeting  the  challenge  of 
doing  the  best  job  you  can  to 
turn  a  program  around,  get 
it  on  its  feet,  and  watch  it  go . 
When  you  undertake  this 
assignment  with  a  planned 
approach  and  a  sense  of 
direction,  this  could  be  one 
of  the  most  rewarding  efforts 
of  your  career. 

As  you  start  to  consider 
ways  to  proceed,  your  first 
task  is  to  discover  what  your  boss  means  when  he  says  that 
the  program  is  in  trouble.  Trouble  is  a  generic  term  which 
has  multiple  meanings.  Symptoms  of  a  program  in  trouble 
could  be:  behind  schedule,  overcost,  failure  to  meet  technical 
requirements,  or  combinations  of  the  above.  But  these  are 
only  symptoms  of  the  problems  which  trouble  the  program. 
Problems  which  result  in  these  symptoms  can  vary.  Your 
boss  has  a  responsibility  to  you  to  identify  the  cause  of  the 
program  difficulties  as  he  sees  it.  When  he  does  this,  he  pro¬ 
vides  you  with  your  marching  orders.  Your  research  may 
even  bring  other  problems  to  light. 

In  a  further  effort  to  determine  the  cause  of  the  trouble, 
you  should  talk  to  various  persons  who  have  worked  on 
the  program  at  different  levels  and  times  and,  therefore,  have 
different  perspectives.  Once  you  have  gathered  all  the  in¬ 
terview  information  you  can,  spend  some  time  evaluating 
everything  you've  heard,  being  sure  to  plug  in  your 
knowledge  of  the  people  with  whom  you  have  talked.  Don't 
spend  an  excessive  amount  of  time  elaborating  on  the 
problem. 
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Let  it  suffice  that  you  know  what  the 
major  cause  of  the  trouble  is  and  have 
succeeded  in  further  identifying  other 
areas  of  concern.  Steer  a  middle  course 
between  your  drive  to  learn  everything 
there  is  to  know  about  how  the  pro¬ 
gram  reached  this  point  and  your 
equally  strong  drive  to  begin  to  turn 
the  program  around.  Because  both  of 
these  considerations  are  important,  do 
not  confine  yourself  to  one  at  the  ex¬ 
pense  of  the  other.  Always  remember, 
however,  that  although  your  objective 
is  to  turn  the  program  around,  you 
cannot  achieve  this  without  knowing 
what  caused  the  trouble  in  the  first 
place  so  that  the  same  mistakes  are  not 
made  again. 

At  this  stage  you  are  attempting  a 
difficult  balancing  act  in  which  you 
want  to  keep  the  program  moving  but, 
at  the  same  time,  change  its  direction 
and  develop  a  new  plan  for  comple¬ 
tion.  Decisions  you  make  now  will  be 
instrumental  in  getting  the  program 
back  on  its  feet  as  soon  as  possible. 
Various  management  tools  and  tech¬ 
niques  are  designed  to  provide  the  pro¬ 
gram  manager  with  the  structure  on 
which  to  build  a  healthy,  successful 
program.  This  key  element  is  the 
recovery  plan  which  will  be  discussed. 

Before  a  plan  can  be  developed  and 
a  team  put  toge  her,  a  program 
manager's  first  step  is  to  ask  what  the 
requirements  of  the  program  are.  In 
other  words,  "What  is  the  objective?” 
To  assist  in  this  task,  a  program 
manager  has  a  variety  of  documents 
available.  The  first  document  is  the 
contract  signed  by  the  company  and 
the  customer.  Another  source  of  data 
is  the  proposal.  Both  documents  will 
provide  the  new  program  manager 
with  details  of  what  has  beeen  agreed 
to  and  all  other  aspects  of  the  program. 
Don't  forget  that  the  proposal  may 
have  been  modified  as  a  result  of 
negotiations.  Get  a  copy  of  those 
changes.  Within  the  basic  question  is 
another  similar  question:  "What  does 
the  contract  say?"  This  question  must 
be  answered  in  the  presence  of  the 
customer  and  with  complete  customer 
agreement.  This  is  not  to  say  that 
reasonable  persons  can't  disagree 
because  we  all  know  they  can. 
However,  any  perception  on  the  part 
of  a  company  which  is  not  agreed  to 
by  the  customer  is  completely  useless 
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as  the  foundation  of  a  program  plan. 
If  there  is  an  honest  disagreement,  we 
all  win  if  that  disagreement  is  brought 
out  as  soon  as  possible.  It  is  totally 
futile  for  a  company  to  proceed  with 
a  plan  which  is  based  only  on  its  own 
perceptions  and  to  which  the  customer 
has  not  even  been  asked  to  lend  its 
agreement. 

The  second  step  critical  to  the  suc¬ 
cessful  completion  of  this  task  is 
picking  the  staff  to  work  with  you  on 
this  problem.  It  is  possible  there  will 
be  no  need  to  adjust  personnel  on  the 
program,  with  the  exception  of  the 
program  manager.  If  identifying  the 
program's  problem  spots  pinpointed 
key  personnel  as  being  part  of  the 
problem,  their  duties  may  have  to  be 
changed,  or  other  assignments  found 
for  them.  However,  it  is  more  likely 
that  the  program  will  profit  by  the  ad¬ 
dition  of  strong  persons  who  are  highly 
skilled  in  specific  areas.  Good  can¬ 
didates  might  be  persons  who  are 
knowledgeable  in  planning.  If  the  pro¬ 
gram  involves  design,  development, 
and  production,  strong  configuration 
management  or  quality  assurance  per¬ 
sonnel  might  be  added.  Adding  com¬ 
petent  personnel  to  a  program  will 
generally  be  accepted  by  personnel 
already  on  a  program.  This,  however, 
becomes  a  more  difficult  situation 
when  the  program  is  in  trouble. 

A  major  point  to  be  remembered  is 
that  every  effort  must  be  made  not  to 
replace  personnel  now  working  on  the 
program.  Often,  personnel  working  on 
a  troubled  program  are  not  highly 
motivated  at  this  time.  Therefore,  the 
new  program  manager  must  make 
changes  very  carefully  to  maintain  cur¬ 
rent  program  momentum.  Finally, 
when  competent  persons  are  added  to 
a  program,  and  are  accepted  by  ex¬ 
isting  personnel,  they  bring  new  ideas 
and  a  fresh  approach  to  existing 
problems.  Keep  in  mind  that  new  is 
not  always  better.  Beware  of  the  "new 
broom  sweeps  clean"  syndrome. 

Now  that  you  have  asked  the  ques¬ 
tion  of  what  the  program  requirements 
are  and  determined  what  staff  changes, 
if  any,  you  should  make,  you  have  to 
get  down  to  the  business  of  devel¬ 
oping  plans  for  completion  of  the  pro¬ 
gram,  You  will  start  with  the  list  of  re¬ 
quirements  which  you  identified  when 


you  reviewed  the  contract  and  the  pro¬ 
posal.  These  requirements  must-be 
handled  one  at  a  time.  For  each  re¬ 
quirement  you  must  show  the  con¬ 
tribution  of  that  requirement  to  the 
program  work  breakdown  structure 
(WBS),  program  schedule,  cost  plan, 
and  technical  plan.  This  may  seem  like 
a  simplistic  approach  to  the  develop¬ 
ment  of  a  new  program  plan  but  it  is 
absolutely  essential  to  have  these  four 
documents  in  total  agreement. 

The  key  to  saving  ourselves  a  lot  of 
effort  is  to  utilize  the  existing  program 
documents  for  the  initial  cut  at 
developing  the  plans.  Allow  yourself 
to  make  required  changes  or  you  might 
lead  yourself  down  the  "yellow  brick 
road"  and  recreate  situations  which 
caused  part  of  the  problem  at  the  start . 
Have  confidence  in  the  decisions  you 
have  reached  as  a  team. 

Reworking  these  plans  is  probably 
the  most  demanding  and  detailed  ac¬ 
tivity  you  will  undertake  to  get  this 
program  back  on  track.  It  may  be  the 
most  important  of  all  tasks.  When  this 
task  is  completed,  which  may  take 
weeks,  you  will  have  provided  the 
total  work  breakdown  structure,  pro¬ 
gram  schedule,  cost  plan,  and  technical 
plan  for  the  completion  of  the  pro¬ 
gram.  One  major  caution  to  observe 
as  you  develop  the  cost  plan  and 
schedule  is  that  you  must  have  an 
understanding  of  these  points  with  the 
personnel  who  will  be  directing  each 
cost  account.  Completion  of  these 
documents  without  the  agreement  of 
these  individuals  is  wasted  effort. 

At  this  point,  you  have  reviewed 
the  requiiements.  You  have  reached 
agreement  with  the  customer,  and 
have  developed  an  understanding  as  to 
what  each  requirement  means.  You 
have  then  analyzed  each  requirement 
to  show  its  cost  and  schedule  impact. 
The  result  is  a  work  breakdown  struc¬ 
ture,  program  schedule,  cost  plan  and 
technical  plan  which  is  realistic  and 
agreed  to  by  all  program  personnel. 

Before  proceeding  to  the  next  phase, 
let's  talk  about  these  documents.  We 
have  noted  they  are  based  on  re¬ 
quirements  as  defined  in  the  contract. 
In  addition,  information  available 
betore  starting  the  effort  on  this 
troubled  program  has  been  used. 
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The  work  breakdown  structure  is 
obviously  one  of  the  key  documents  in 
any  program.  In  the  particular  situa¬ 
tion  with  which  we  are  dealing,  a  work 
breakdown  structure  most  probably 
exists.  As  the  new  program  manager, 
you  will  make  every  effort  to  use  this 
document  to  the  highest  degree  pos¬ 
sible.  Should  a  situation  arise  where  it 
becomes  necessary  to  make  a  major 
modification  to  the  program  WBS,  it 
will  require  the  approval  of  the 
customer.  Whether  or  not  changes  are 
required,  the  final  WBS  must  be  the  ex¬ 
pression  of  the  total  program  you  will 
be  directing. 

1  he  program  schedule  you  develop, 
based  on  your  review  of  the  re¬ 
quirements,  can  take  almost  any  form. 
It  should  be  a  form  with  which  you  are 
comfortable.  Whatever  form  you 
chose,  it  must  be  totally  consistent  and 
driven  by  program  requirements.  It 
must  be  consistent  with  the  WBS  you 
have  developed. 

The  major  usefulness  of  the  schedule 
in  monitoring  the  conduct  of  the  pro¬ 
gram  is  twofold.  First,  the  schedule  is 
the  key  "sheet  of  music"  from  which 
everyone  sings.  Second,  each  program 
milestone  is  identified  on  this  program 
schedule.  From  this  schedule,  we  can 
draw  a  list  of  these  milestones  and  sort 
them  by  responsible  individual  by 
month.  This  then  provides  a  tool  you 
can  use  monthly  to  ensure  you  are  do¬ 
ing  everything  possible  to  keep  the 
program  on  schedule.  You  now  have 
identified  tasks  which  must  be  ac¬ 
complished,  responsible  individuals, 
and  due  date  for  each  task.  Milestones 
should  be  posted  for  all  to  see  and 
understand. 

The  third  major  output  of  the 
analysis  of  the  requirements  is  a  cost 
plan.  The  cost  plan  is  a  detailed  listing 
of  the  monies  to  be  spent  through  the 
completion  of  the  program.  It  must 
show  each  task  and  the  expenditures 
planned.  The  plan  must  be  consistent 
with  the  WBS  and  the  schedule  which 
has  been  developed.  It  must  list  expen¬ 
ditures  to  be  made  by  task  and  by 
month. 

The  way  that  you  use  this  cost  plan 
is  directly  related  to  the  cost  system  ex¬ 
isting  in  your  company.  If  you  are  for¬ 
tunate,  you  can  receive  actual  expen¬ 
ditures  weekly  by  cost  account.  I  will 

Program  Manager 


make  that  assumption  during  this  dis¬ 
cussion.  If  you  get  this  data  monthly, 
you  should  follow  the  same  general 
procedures  we  will  be  discussing.  Of 
course,  you  only  will  be  able  to 
analyze  the  program  cost  status 
monthly. 

Finally,  you  come  to  the  technical 
plan.  This  is  a  description  of  the  tasks 
required  to  accomplish  technical  re¬ 
quirements  for  the  program.  It  includes 
all  the  design,  development,  manufac¬ 
turing  and  test  efforts  leading  to  pro¬ 
gram  completion.  This  plan  should  be 
prepared  by  senior  engineering  person- 
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nel  working  on  the  program.  It  should 
directly  relate  to  the  WBS,  in  that  it 
identifies  and  provides  many  of  the 
tasks  which  make  up  the  structure. 
This  leads  to  the  major  input  of  the 
preparation  of  the  program  schedule 
and  the  cost  plan. 

Now  we  will  consider  that  phase  of 
the  effort  easiest  to  ignore;  that  is,  the 
follow-through  on  plans  you  have 
established.  The  reason  it  is  easy  to  ig¬ 
nore  follow-through  is  that  it  requires 
tremendous  attention  to  detail;  fol¬ 
lowing  problems  through  second  and 
third  order  questions  will  find  the  pro¬ 
gram  manager  tired  of  repeating  the 
same  detailed  questions.  Major  words 
in  your  vocabulary  are  why,  when, 
and  why  not7 


Two  too!;,  you  will  use  during  the 
second  phase  of  your  recovery  plan  are 
weekly  cost  reports,  plus  your  mission 
report.  Weekly  cost  reports  will  vary 
depending  on  the  type  of  information 
you  get  from  your  company's  manage¬ 
ment  information  system.  This  will 
allow  the  program  manager  to  deter¬ 
mine  two  points  about  each  cost  ac¬ 
count.  Ideally,  the  program  manager 
should  be  able  to  track  actual  versus 
plannned  cost  expenditures  on  a 
weekly  basis.  Variations  between 
planned  and  actual  costs  are  the  first 
indications  that  you  will  need  to  delve 
into  the  particular  cost  account  using 
the  "why"  and  "when"  technique.  It  is 
probably  more  important  to  the  pro¬ 
gram  manager  when  the  cost  account 
manager  is  underspending  than  as 
when  one  is  overspending.  When 
underspending  is  occurring,  it  prob¬ 
ably  means  that  work  is  not  being 
done.  It  is  probable  that  you  will  see 
a  slip  in  the  schedule.  Of  course  it  may 
be  the  work  is  be>ng  done  for  less  than 
the  original  estimate.  This  is  the  best 
of  all  worlds.  Overspending  is  the 
more  obvious  data  to  be  followed  in 
great  detail. 

The  second  point  to  consider  when 
reviewing  cost  data  is  any  change  in¬ 
dicated  in  the  final  cost  of  each  ac¬ 
count.  At  first  glance,  you  may  think 
that  this  indication  is  easy  to  visualize. 
It  is  not  so  clear  cut,  however,  when 
you  look  deeper.  There  are  three  possi¬ 
ble  variations  when  you  look  at 
changes  in  the  indicated  final  cost  (IFC) 
during  a  period  of  time:  (1)  that  the 
plan  has  not  changed,  (2)  the  newer 
IFC  has  decreased,  or  (3)  the  IFC  has 
increased.  If  the  IFC  has  not  changed 
and  all  milestones  are  being  met,  then 
the  cost  account  is  under  control. 
Growth  of  the  IFC  is  a  danger  sign 
which  must  be  investigated  until  the 
program  manager  understands  the 
cause  of  the  cost  growth.  Finally,  a 
decrease  in  the  IFC  is  good  for  the  total 
cost  of  the  program  only  if  milestones 
are  being  met.  This  means  that  you 
didn't  have  a  particularly  good 
estimate  in  the  beginning.  You  can  live 
with  those  types  of  mistakes. 

A  full  analysis  of  the  indicated  final 
cost  must  be  done  in  conjunction  with 
the  milestone  schedule.  It  is  critical  that 

(Sec  SA  VED ,  page  39  ) 
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his  paper  discusses 
and  provides  an  ex¬ 
ample  of  how  management 
control  of  acquisitions  can 
be  increased  through  the  use 
of  fundamental  management 
principles  in  tailoring 
Department  of  D«(ense  stan¬ 
dards.  As  defined  in  DOD 
Directive  5000.43,  acquisi¬ 
tion  streamlining  is  any  ac¬ 
tion  that  results  in  more  ef¬ 
ficient  and  effective  use  of  re¬ 
sources  to  develop,  produce, 
and  deploy  quality  defense 
systems  and  products.1 

Overspecification  is  the  use  of  overly  restrictive,  inap¬ 
propriate,  or  extraneous  standards  and  specifications,  in  part 
or  in  whole.  Thus,  in  its  application  to  defense  solicitations 
and  contracts,  acquisition  streamlining  seeks  to  avoid 
overspecification  by  ensuring  that  only  the  standards  and 
specifications2  appropriate  to  each  stage  of  the  acquisition 
process  are  utilized  and  that  the  standards  and  specifications 
are  tailored  to  the  circumstances  of  the  particular  acquisi¬ 
tion.  Acquisition  streamlining,  as  used  in  this  paper,  ad¬ 
dresses  the  tailoring  of  military  standards. 

Background 

Overspecification  is  an  expensive  and  cumbersome  ac¬ 
quisition  control  process.  Yet,  our  experience  on  numerous 
system  acquisitions  reveals  that  overspecification  is  com¬ 
mon.  The  1977  Report  of  the  Task  Force  on  Specifications 
and  Standards  of  the  Defense  Science  Board  provides  the 
results  of  an  extensive  study  on  the  use  of  standards  and 
specifications  to  project  needs,  thereby  avoiding  over¬ 
specification.3  The  MIL-HDBK-248,  however,  did  not 
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result  in  improved  use  of 
standards  and  specifications, 
as  the  Board  had  recom¬ 
mended.4 


More  recently,  the  Presi¬ 
dent's  Blue  Ribbon  Commis¬ 
sion  on  Defense  Manage¬ 
ment  (the  Packard  Commis¬ 
sion)  made  recommenda¬ 
tions  for  improving  acquisi¬ 
tion  organization  and  pro¬ 
cedures.5  These  and  other 
recommendations  are  being 
implemented  through  the 
reorganization  of  the 
Department  of  Defense  and  restructuring  of  the  acquisition 
management  process.  Program  managers  and  managers  in 
the  newly  established  position  of  Program  Executive  Officer 
must  now  operate  in  an  environment  in  which  efficiency  and 
control  of  major  system  acquisitions  are  principal  and  highly 
visible  objectives.  In  this  context,  it  is  useful  to  consider  the 
role  of  standards  and  specifications  in  achieving  manage¬ 
ment  control  and  to  identify  ways  in  which  they  can  be  used 
more  efficiently  and  effectively  as  management  control  tools. 

Standards  and  specifications  generally  are  based  on  sound 
management  principles  and  cumulative  industry  experience 
for  achieving  desired  results.  However,  in  the  standard  and 
specifications  themselves,  this  information  has  been  con¬ 
verted  into  sets  of  prescribed  activities,  to  the  exclusion  of 
the  principles  and  experience  on  which  they  are  based. 
Although  it  is  intended  that  the  standards  and  specifications 
be  tailored  to  the  specific  acquisition  program,  the  focus  on 
activities  fails  to  provide  managers  with  the  necessary 
tailoring  information.  Emphasizing  the  management  prin- 
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ciptes  and  desired  results  underlying 
the  standards  and  specifications  will 
lead  to  simpler,  more  cost-effective 
program  controls  and  to  more 
streamlined  acquisitions.^ 

Purpose  of  Standards  in  Manage¬ 
ment  Control 

To  identify  areas  in  which  standards 
can  be  streamlined,  it  is  useful  to  ex¬ 
amine  their  purpose.  Military  stan¬ 
dards  are  intended  to  provide  the  con¬ 
trols  necessary  to  assure  that  the  pro¬ 
ject  work  proceeds  smoothly, 
properly  and  according  to  accepted 
methodologies.  Controls  are  informa¬ 
tion  and  measurements  that  provide  a 
means  to  an  end— management  con¬ 
trol  or  direction  of  the  project  work. 
Tailoring  of  standards  requires  an 
understanding  of  the  characteristics  of 
effective  controls  and  of  how  controls 
are  used  to  provide  project  direction. 

Peter  F.  Drucker  points  out  that  in 
the  context  of  management,  the  word 
"controls”  is  not  the  plural  of  the  word 
"control,"  and  that  more  controls  do 
not  necessarily  give  more  control.7 
Drucker  identifies  criteria  that  control 
must  satisfy  to  give  managers  con¬ 
trol.8  Among  these  criteria  are  that 
controls  must  be  appropriate  to  the 
character  and  nature  of  the  phenomena 
measured.  In  addition,  controls  must 
be  economical  and  simple.  That  is, 
they  must  provide  the  minimum  infor¬ 
mation  needed  to  understand  a 
phenomenon;  they  must  not  be  overly 
complicated.  Too  much  information 
and  complexity  will  cause  confusion 
and  misdirection,  thereby  undermining 
management  control.  Further,  controls 
must  focus  on  results  and  key  objec¬ 
tives.  Whereas  control  of  a  few  factors 
can  yield  a  significant  impact  on  per¬ 
formance  and  results,  control  is  lost  by 
trying  to  direct  the  infinity  of  events 
that  are  marginal  to  performance  and 
results.  Finally,  controls  must  be 
focused  on  action;  they  should  not 
generate  information  for  its  own 
sake.9 

Military  standards  provide 
methodologies  for  carrying  out  specific 
types  of  work,  such  as  engineering 
management,  configuration  manage¬ 
ment,  and  software  development  or  for 
developing  management  or  technical 
tools,  such  as  a  work  breakdown 
structure,  a  trade-off  study,  or  a  test 
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and  evaluation  plan.  Standards,  when 
cited  in  contracts,  prescribe  the 
methodologies  to  be  used  to  develop 
and  execute  the  program  baseline;  i.e., 
the  critical  cost,  schedule,  and 
technical  information  against  which 
progress  will  be  measured.  Thus,  in¬ 
voking  standards  is  invoking  a  system 
of  controls  on  how  management  will 
be  carried  out,  and  implementing  the 
standards  on  a  project  generates  the 
management  controls  (i.e.,  informa¬ 
tion  and  measurements)  for  that 
specific  project.  Project  direction  is 
based  on  the  information  provided  by 
the  project-specific  controls. 

For  example,  the  MIL-STD-490A 
system  specification  standard  provides 
a  set  of  controls  for  developing  the 
system's  functional  and  performance 
characteristics.10  Once  developed,  the 
system  specification  becomes  a  control 
for  subsequent  engineering  work.  The 
MIL-STD-881A  work  breakdown 
structure  standard  provides  controls 
for  developing  the  cost  and  scheduling 
baseline.11  Once  developed,  the  work 
breakdown  structure  in  conjunction 
with  the  project  cost  and  schedule  data 
becomes  the  project  cost  and  schedule 
controls.  The  MIL-STD-1521B  estab¬ 
lishes  the  controls  for  conducting  for¬ 
mal  program  reviews.12  The  reviews 
themselves  are  controls  on  the  stages 
of  project  work. 

Because  military  standard*-  desrribp 
generic  methodologies,  they  do  not 
provide  controls  that  satisfy  Drucker's 
criteria.  Without  modification,  these 
standards  will  not  support  manage¬ 
ment  control.  Therefore,  to  increase 
management  control,  standards  must 
be  tailored  to  be  appropriate  to  the 
specific  acquisition  project.  The 
absence  of  correct  tailoring  can  result 
in  a  program  baseline  that  is  excessive, 
inappropriate,  or  confused.  Directing 
project  work  according  to  such  a 
baseline  can  lead  to  the  conduct  of  in¬ 
appropriate  work  and  to  the  inability 
to  assess  project  status  or  progress. 

Enhancing  management  control 
takes  on  particular  importance  in  view 
of  recent  legislation  and  Department  of 
Defense  policy.  Specifically,  the 
Defense  Acquisition  Improvement  Act 
of  1986  implements  the  Packard  Com¬ 
mission  recommendation  that 
managers  of  major  new  programs 
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prepare  a  baseline  agreement 
describing  functional  specifications, 
cost,  schedule,  and  other  factors 
critical  to  the  program's  success.13 
Within  the  terms  of  the  agreement,  the 
program  manager  is  expected  to  be 
given  full  authority  to  execute  the  pro¬ 
gram.  The  Packard  Commission 
recommended  that  program  managers 
who  adhere  to  their  baseline  be  given 
DOD  support  before  the  Congress  for 
multiyear  funding.  Tailoring  of  stan¬ 
dards  is  essential  to  developing  a  well- 
defined,  achievable  program  baseline 
and  to  providing  the  management  con¬ 
trol  to  stay  within  that  baseline. 
Therefore,  the  adaptation  of  military 
standards  to  provide  effective  controls 
is  essential  to  attaining  stable  and 
autonomous  acquisition  programs. 

Management  Principles 

Successful  streamlining  begins  by 
analyzing  the  work  according  to  fun¬ 
damental  management  principles. 
These  principles  are  as  follows:  (1) 
organize  the  work  according  to  the  ob¬ 
jectives  of  the  project,  (2)  organize  the 
work  into  homogeneous  stages  that  are 
individually  assessable  in  terms  of 
operational  requirements,  and  (3) 
organize  the  work  in  each  project  stage 
according  to  its  outputs.14  This 
analysis  of  work  allows  us  to  organize 
the  acquisition  project  so  that  it  can  be 
directed  and  controlled.  After  com¬ 
pleting  such  an  analysis,  we  can 
streamline  the  standards  for  system 
specifications,  work  breakdown  struc¬ 
tures,  and  reviews  and  audits  for  the 
specific  requirements  of  the  project.15 
Tailoring  the  standards  to  the  project 
provides  tools  and  information  to  sup¬ 
port  management  control.  In  our  ex¬ 
ample,  we  will  streamline  these  stan¬ 
dards  for  acquisition  of  a  hypothetical 
transportable  C3I  system  that  is  com¬ 
posed  primarily  of  commercial  off-the- 
shelf  equipment.16 

Streamlining  a  Transportable  C3I 
System  Acquisition 

Streamlining  of  a  transportable  C3I 
system  is  illustrated  in  Figure  1.  The 
objective  of  acquiring  transportable 
C3I  systems,17  as  opposed  to  fixed 
facilities,  introduces  certain  pecu¬ 
liarities  into  the  acquisition  process 
that  prevent  the  direct  application  of 
standards.  That  is,  while  the  prime 
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items13  of  a  transportable  C3I  system 
are  the  individual  shelters  and  their 
contents,  none  of  the  shelters  necessari¬ 
ly  performs  an  operational  end-use 
function.  This  is  because  the  system 
must  be  broken  down  into  configura¬ 
tions  that  will  tit  the  physical  limita¬ 
tions  of  the  shelters.  This  concept  is 
shown  in  Figure  i  in  which  Stage  2  is 
organized  according  to  operational 
end-use  tunctions  (air  defense,  in¬ 
telligence,  tire  support)  and  Stage  4  is 
organized  by  prime  item  (i.e.,  the 
transportable  shelters  and  their  con¬ 
tents.  In  this  example  there  are  two 
prime  items,  a  shelter  containing  the 
communications  equipment  and  a 
shelter  containing  the  automated  data 
processing  equipment. 

The  prime  items  of  fixed  systems 
perform  distinct  end-use  functions,  and 
the  standards  for  system  specifications, 
work  breakdown  structures,  and 
reviews  and  audits  are  directed  toward 
the  development  of  prime  items  that 
perform  end-use  functions.  In  contrast, 
tor  a  transportable  rystem  the  early 
stages  of  work  1  st  be  defined  ac¬ 
cording  to  end-ujv  functions.  In  con¬ 
trast,  lor  a  transportable  system  the 
early  stages  of  work  must  be  defined 
according  to  end-use  functions,  while 
the  later  stages  of  work  are  defined  ac¬ 
cording  to  prime  items.  Thus,  the  stan¬ 
dards  must  be  tailored  to  accom¬ 


modate  this  difference. 

This  unique  feature  is  an  important 
factor  in  determining  the  work  to  be 
performed  to  build  a  transportable 
C3I  system.  Proceeding  backward,  the 
work  can  be  determined  as  follows: 
The  last  step  is  the  fielding  of  the 
system.  Prior  to  fielding,  the  system 
must  be  completely  fabricated  and 
qualified.  The  last  step  in  fabrication 
is  placing  the  equipment  into  the 
shelters.  It  is  important  to  assure  that 
the  system  works  properly  before  it  is 
placed  into  the  shelters  to  reduce  the 
risk  of  having  to  remove  any  part  of 
the  system  after  placement  in  the 
shelters.  To  accomplish  this,  the 
system  must  be  totally  assembled  in  a 
single  location  and  all  the  major  func¬ 
tions  verified.  Prior  to  that  stage,  the 
individual  system  components  must  be 
assembled  and  qualified.  Prior  to  the 
assembly  and  qualification  of  the  in¬ 
dividual  components,  these  com¬ 
ponents  must  be  identified. 

Based  on  this  analysis,  the 
homogeneous  stages  of  work  are  as 
follows:  (1)  identify  the  system  com¬ 
ponents  through  trade-off  studies  and 
other  analyses,  (2)  fabricate  the  com¬ 
ponents,  (3)  integrate  the  components 
into  the  complete  system,  (4)  assemble 
the  system  into  the  shelters,  and  (5) 
field  the  system. 


Streamlining  has  been  achieved,  in 
part,  by  adapting  the  work  to  the  non- 
developmental  nature  of  the  acquisi¬ 
tion.  The  component  fabrication  stage 
has  been  substituted  for  the  conven¬ 
tional  configuration  item  design, 
development,  and  fabrication  stages. 
The  result  is  that  the  government  pro¬ 
ject  office  manages  a  larger  unit  of 
work  and  eliminates  unnecessary 
work,  and  the  contractor  is  relieved  of 
the  burden  of  producing  performance 
and  fabrication  specifications  for  small 
components  of  the  work. 

Additional  streamlining  may  be 
achieved  in  selecting  the  size  of  the 
components  receiving  management  at¬ 
tention.  These  components  can  be 
systems,  subsystems,  or  configuration 
items.  Selection  of  these  components 
affects  the  degree  of  management  con¬ 
trol  of  the  project  by  the  government 
and  is  a  decision  that  the  project 
manager  must  make.  When  the  ac¬ 
quisition  comprises  primarily  commer¬ 
cial  off-the-shelf  items,  the  indepen¬ 
dent  components  can  be  complete 
systems  or  subsystems  without  unac¬ 
ceptable  loss  of  control,  rather  than  the 
usual  hardware  or  software  configura¬ 
tion  items  called  for  by  the  system 
specification  standard. 

The  work  breakdown  structure 
follows  directly  from  the  stages  of 
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work  derived  tor  the  system  acquisi¬ 
tion.10  In  particular,  the  work 
breakdown  structure  uses  the  stages  as 
major  elements  and  supplements  these 
elements  by  the  work  that  cannot  be 
attributed  to  any  specific  element,  such 
as  project  management.  The  work  in 
any  stage  is  organized  around  the  out¬ 
put  of  that  stage.  The  output  of  Stage 
1  is  the  system  specification.  The  out¬ 
puts  ot  Stage  2  are  the  components  that 
perform  specific  end  use  functions.  The 
output  of  Stage  3  is  the  totally  in¬ 
tegrated  system.  The  outputs  of  Stage 

4  are  the  prime  items;  i.e.,  the  shelters 
and  their  contents.  The  output  of  Stage 

5  is  the  operational  system. 

Streamlining  of  the  standard  on 
reviews  and  audits  follows  directly 
from  the  definition  of  the  stages.  The 
completion  of  each  stage  represents  a 
milestone  in  the  project.  A  major 
review  is  conducted  to  verify  that 
work  within  a  given  stage  has  been 
completed  and  that  the  next  stage  can 
proceed  without  serious  risk  of  having 
to  repeat  l  r  correct  work  performed 
previously. 

Tailoring  of  these  standards  is 
guided  by  the  requirement  to  maintain 
project  management  control.  Manage¬ 
ment  control  is  achieved  in  this  exam¬ 
ple  by  designing  each  stage  of  work  to 
be  operationally  assessable.  Conse¬ 
quently,  the  reduction  in  the  number 
of  work  stages,  the  selection  of 
relatively  large  system  components 
receiving  management  attention,  and 
the  reduction  in  the  number  of  reviews 
and  audits  do  not  expose  the  govern¬ 
ment  to  an  unacceptable  level  of  risk 
since  at  each  project  milestone  mean¬ 
ingful  feedback  on  program  progress 
can  be  obtained.  A  further  benefit  of 
operational  assessability  is  that  the 
responsibility  for  completing  the  pro- 
ject  can  be  transferred  to  a  new 
organization  at  minimum  expense  at 
the  end  of  any  single  stage  of  work,  if 
necessar\ 


Conclusion 

We  nave  shown  how  fundamental 
principles  of  management  can  be  used 
to  streamline  acquisitions  signifi¬ 
cantly,  We  have  reduced  the  stages  of 
work  receiving  management  attention, 
simplified  the  work  breakdown  struc¬ 
ture,  and  reduced  the  number  of 
milestone  reviews.  This  has  been  done 
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by  careful  analysis  ot  the  work  re¬ 
quired  to  build  a  transportable  CM 
system.  We  have  used  the  results  ot 
our  analysis  to  tailor  selected  standards 
to  the  unique  characteristics  ot  the 
project. 

This  approach  to  streamlining  will 
increase  management  control.  By  con¬ 
densing  the  standards  to  produce  only 
essential  information,  we  have  made 
our  control  mechanisms  economical 
and  relevant.  By  carefully  specifying 
stages  of  work  and  milestone  reviews, 
we  provide  the  necessary  control  infor¬ 
mation  at  appropriate  places  in  the 
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development  process.  Finally,  by 
designing  the  stages  of  work  to  pro¬ 
duce  operationally  assessable  outputs, 
we  obtain  the  information  necessary  to 
determine  whether  the  project  may 
productively  proceed  to  the  next  stage 
of  work  or  whether  and  what  addi¬ 
tional  actions  are  required  to  complete 
the  current  work  stages. 

By  reducing  the  number  of  controls, 
the  span  of  control  of  individual 
managers  may  be  increased,  thereby 
allowing  a  small  project  office  to 
manage  effectively  a  large  acquisition. 

Our  streamlining  example  satisfies 
the  recommendations  of  the  Packard 
Commission  Report20  encouraging 
streamlining  of  military  specifications 
for  commercial  off-the-shelf  items  and 
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invoking  neither  minimum  nor  max¬ 
imum  but  only  relevant,  re¬ 
quirements.  Our  proposed  streamlin¬ 
ing  principles  support  the  development 
ot  achievable  program  baselines  tor 
major  system  acquisitions,  which  con¬ 
tribute  to  program  stability  and 
autonomy.  These  principles  support 
implementation  of  the  Packard  Com¬ 
mission's  recommendation  to  reduce 
substantially  the  number  of  acquisition 
personnel. 

These  management  principles  may 
be  applied  to  acquisitions  requiring 
high-risk  developmental  items,  such  as 
new'  software.  By  utilizing  principles 
discussed  here,  the  project  manager 
may  tailor  the  management  controls  to 
be  commensurate  with  the  risk  posed 
by  developmental  items. 
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the  person  responsble  for  the  cost  ac¬ 
count  keep  the  plan  updated  as  ~.e 
situation  changes  on  the  program. 

The  second  tool  is  a  milestone 
report.  The  source  of  data  you  use  to 
generate  the  milestone  report  is  the 
program  schedule.  You  must  recall 
that  you  developed  the  schedule  by  sit¬ 
ting  with  the  individuals  responsible 
for  program  milestones  and  devel¬ 
oping  each  phase  together.  As  you  sat 
with  those  individuals  to  discuss  the 
total  program  schedule,  you  identified 
details  supporting  overall  program 
schedule.  This  resulted  in  the  milestone 
report. 

The  structure  of  the  milestone  report 
is  such  that  each  task  to  be  accom¬ 
plished  is  identified  chronologically  by 
month,  by  individual.  For  very  large 
programs,  you  might  only  show  mile¬ 
stones  to  be  accomplished  during  the 
present  month,  and  the  next  two 
months.  One  major  point  is  that  you 
never  remove  a  milestone  unless  it  has 
been  accomplished.  Therefore,  you 
continue  to  show  milestones  which 
have  not  been  completed  even  though 
the  scheduled  completion  date  has 
passed.  The  analysis  of  this  report 
must  be  completed  in  conjunction  with 
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14.  Drucker,  pp.  198-206. 

15.  MIL-STD-490A,  Specification 
Practices.  MIL-STD-881  A,  Work 
Breakdown  Structures  for  Defense 
Materiel  Items,  and  MIL-STD-1521B, 
Technical  Reviews  and  Audits  for 
Systems,  Equipments,  and  Computer 
Software. 

16.  Military  standards  and  specifica¬ 
tions  were  developed  for  acquisition  of 
weapons  systems.  Applying  standards 
and  specifications  to  C3I  systems  re¬ 
quires  more  tailoring  than  for  weapons 
systems. 

17.  Transportable  C3I  systems  as  used 
here  refer  to  those  systems  that  are 
housed  in  shelters  that  can  be 
transported  by  air,  sea,  rail  or  road 
carriers. 

18.  A  prime  item  is  a  complex  item 
such  as  an  aircraft,  missile,  launcher 
equipment,  fire  control  equipment,  or 
radar  set,  which  is  formally  accepted 


by  the  government.  A  prime  item 
typically  performs  an  end-use 
function. 

19.  Good  work  breakdown  structures 
will  correspond  to  the  standard  only 
in  the  case  of  familiar  weapons 
systems.  Appendix  B  of  the  standard, 
the  work  breakdown  structure  for  elec¬ 
tronics  systems,  is  not  suited  for  C3I 
systems. 

20.  President's  Blue  Ribbon  Commis¬ 
sion  on  Defense  Management,  pp. 
39-71. 


Mr.  Brown  has  14  years  experience  in 
system  acquisitions  management  at 
MITRE,  IBM,  Lockheed  and  Litton. 
Judith  Gordon  has  12  years  experience  in 
economic  and  policy  analysis  and  system  ac¬ 
quisition  management  at  MITRE, 
Aerospace  and  elsewhere. 


the  cost  report.  When  you  do  that  we 
add  to  the  usefulness  of  each  report. 

In  summary,  as  the  newly  assigned 
program  manager  on  a  troubled  pro¬ 
gram,  your  first  task  is  to  gather  data 
initially  from  your  boss,  and  then  from 
individuals  working  on  the  program. 
Next,  you  form  your  team,  utilizing 
qualified  and  knowledgeable  existing 
team  members  and  adding  to  that  team 
where  necessary.  Then,  a  review  of  re¬ 
quirements  is  begun  so  that  you  can 
build  the  foundation  for  the  comple¬ 
tion  of  the  program.  This  review 
results  in  cost,  schedule  and  technical 
plans  to  drive  the  actions  to  be  taken 
to  complete  the  program.  Publication 
of  your  monthly  plans  lists  the  report 
cards  against  which  you  are  going  to 
measure  the  performance  of  your  team 
on  these  tasks.  The  proof  is  if  you  are 
able  to  meet  your  milestones  and 
maintain  cost  control  on  the  program. 

When  you  are  tasked  to  take  charge 
of  a  troubled  program,  take  comfort 
in  the  fact  that  there  are  definite  ac¬ 
tions  that  you  can  pursue  which  can 
lead  to  one  of  the  most  rewarding 
assignments  in  your  career.  This 
almost  undefined  task  of  monitoring 


and  checking  the  daily,  weekly,  and 
monthly  program  performance  will 
contribute  greatly  to  your  program's 
success.  The  greatest  plan  in  the  world, 
if  not  monitored,  will  not  yield  the 
desired  results. 

The  challenge  is  tough  but  rewarding. 


Mr.  Stinson  graduated  from  the  Defense 
Systems  Management  College  with  PMC 
72-2.  He  served  in  the  REMBASS  Pro¬ 
gram  Management  Office,  Fort  Mon¬ 
mouth,  N.J.,  and  retired  from  the  Army 
in  1977.  He  since  has  been  a  fmgram 
manager  for  GTE  and  for  HRB-Singer  on 
four  major  program „. 
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Michael  G.  Krause 


he  search  for  man¬ 
agerial  excellence  can 
be  challenging  and  fun. 

Some  students  in  the  Ex¬ 
ecutive  Management  and 
Program  Management 
Courses  at  the  Defense 
Systems  Management  Col¬ 
lege  (DSMC)  have  the  op¬ 
portunity  to  participate  in 
the  Looking  Glass  organiza¬ 
tional  simulation.  Mirroring 
the  Department  of  Defense 
world  of  acquisition  man¬ 
agement,  participants  ascer¬ 
tain  what  it  means  to  be 
a  manager  in  a  world  of  pressure,  conflict,  ambiguity,  im¬ 
perfect  communication,  and  resource  constraints. 

Looking  Glass,  Inc.,  a  50-year  old  glass  company  with 
eight  plants,  4,000  employees  and  $200  million  in  sales,  is 
the  setting  for  this  top-rated  commercial  simulation.  The  cor¬ 
poration  has  three  divisions.  Each  division  has  a  vice  presi¬ 
dent,  and  directors  of  sales  and  marketing,  manufacturing, 
and  product  development.  The  eight  plant  managers  report 
to  their  division's  director  of  manufacuring.  In  addition  to 
their  line  responsibility,  the  president  and  three  vice 
presidents  serve  on  the  management  committee. 

For  six  and  a  half  hours,  20  students  are  the  company's 
top  management  team  and  deal  with  typical  tasks  such  as 
resource  allocation,  public  policy,  long-  and  short-term  plan¬ 
ning,  personnel,  lawsuits,  acquisitions,  and  issues  which 
might  face  managers  in  a  corporation  of  this  magnitude. 
Many  of  the  day's  tasks  are  apparent  from  materials  pro¬ 
vided  to  participants.  There  are  challenges  and  opportunities 
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which  can  be  identified 
through  memos,  chance 
meetings,  telephone  calls, 
planned  meetings,  or  news¬ 
paper  articles.  This  is  a  day 
in  the  life  of  a  manager. 

How  does  Looking  Glass 
help  managers  who  are 
students  at  the  Defense 
Systems  Management  Col¬ 
lege?  By  freeing  participants 
from  their  real  organiza¬ 
tional  life  which  is  bounded 
by  policy  and  procedures, 
they  are  able  to  concentrate 
on  management.  Running  a  glass  company  becomes  a  useful 
tool  for  identifying  or  verifying  one's  managerial  style,  and 
reflecting  on  how  that  style  influences  other  people.  The 
glass  industry  content  is  not  important.  For  example,  par¬ 
ticipants  do  not  need  a  marketing  degree  to  be  successful 
as  a  director  of  sales  and  marketing,  or  an  engineering  degree 
to  be  successful  as  a  director  of  product  development.  How 
the  day's  work  is  done,  how  problems  are  managed,  and 
how  decisions  are  made  are  the  simulation's  essence.  To 
paraphrase  Mark  Twain,  you  can't  change  a  person's  point 
of  view  if  their  job  security  is  at  risk. 

Participants  are  introduced  to  the  simulation  the  day  be¬ 
fore  the  action  begins.  They  view  a  narrative  slide  show  to 
gain  more  understanding  of  the  corporation.  Additional  real¬ 
ism  is  added  as  participants  receive  a  glossy  and  embossed 
Looking  Glass  Annual  Report.  They  learn  ground  rules  for 
the  simulation,  and  are  told  the  plant  managers  are  at  cor¬ 
porate  headquarters  for  a  bimontly  meeting.  At  this  point 
students  usually  select  positions  they  will  assume. 
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An  in-basket  is  given  out  of  memos 
and  reports  the  incumbent  in  each 
position  sent  and  received  the  previous 
day.  The  DSMC  faculty  member  con¬ 
ducting  this  introductory  session  sug¬ 
gests  that  participants  should  not 
spend  more  than  2  hours  processing 
the  materials  before  the  simulation. 


Arriving  at  work,  each  participant 
finds  an  office  area  with  a  desk,  phone, 
in  out  basket,  office  supplies  (paper, 
pencils,  pens,  and  stationary),  waste 
basket,  and  chairs.  Meeting  tables  are 
available.  Vice  presidents  usually  share 
a  room,  and  each  of  the  divisions  have 
personnel  clustered  in  three  other 
rooms  furnished  in  similar  manner. 


Soon,  telephones  start  ringing, 
meetings  are  scheduled,  memos  are 
written,  and  people  start  talking.  There 
is  an  opportunity  for  chance  meetings 
at  the  coffee  pot  or  water  fountain.  For 
the  skeptical  participant,  running 
Looking  Glass,  Inc.,  becomes  real.  It 
does  not  matter  if  they  have  private 
sector  experience.  Their  true  person¬ 
ality  and  managerial  style  takes  over 
as  they  respond  to  senior  managers  or 
handle  managerial  tasks  unfolding  dur¬ 
ing  the  simulation.  Reflecting  on  his 
Looking  Glass  experience.  Colonel 
Wendell  B.  Wood,  USAF,  said  par¬ 
ticipating  made  him  realize  that  effec¬ 
tive  managerial  practices  work  in  all 
organizations— profit  and  nonprofit; 
and.  that  it  reinforced  his  managerial 
style. 

A  buffet  is  set  up  so  that  Looking 
Glass  managers  may  eat  when  it  is  con¬ 
venient.  This  allows  the  momentum  of 
the  simulation  to  remain  high.  It  also 
may  be  the  first  opportunity  for  some 
managers  to  meet.  A  working  lunch  is 
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not  out-of-the-question.  Often, 
problems  discussed  earlier  reemerge 
and  may  be  redefined  based  on  new  in¬ 
formation  learned  during  lunch 
conversations. 


At  home,  the  participant  is  free  to 
review  and  prepare  the  information  in 
any  fashion.  Reading  the  materials 
often  triggers  ideas  of  what  the  com¬ 
pany  needs,  and  an  awareness  of  the 
work  which  must  be  done  during  the 
simulation.  The  way  a  student  deals 
with  homework  often  replicates  work 
taken  home  from  the  real  job. 


As  the  next  day  begins,  Looking 
Glass  managers  go  to  their  offices,  the 
telephone  switchboard  is  turned  on, 
and  the  business  of  running  a  multi¬ 
million  dollar  firm  begins.  The  20  par¬ 
ticipants  have  been  told  they  are  free 
to  run  the  company  as  they  please. 


With  positive  and  negative  feed¬ 
back,  the  student  is  able  to  identify 
managerial  strengths  and  weaknesses, 
and  develop  plans  to  improve  effec¬ 
tiveness.  Debriefings  give  the  partici¬ 
pant  an  opportunity  to  reflect  on  the 
organizational  climate  and  hierarchical 
relationships  which  developed,  how 


information  flowed,  where  time  and 
energy  were  invested,  how  decisions 
were  made,  and  how  well  the  division 
and  company  performed. 


As  the  last  part  of  the  simulation, 
the  president  has  scheduled  a  speech  on 
the  state  of  the  corporation.  When  it 
is  complete,  the  simulation  will  be 
over.  Decisions  were  made,  memos 
were  written,  meetings  were  held  or 
scheduled,  phones  were  used,  and 
studies  were  initiated.  Participants  are 
surprised  to  find  out  that  the  simula¬ 
tion  has  no  last-minute  surprises  or 
mid-course  corrections.  They  really 
were  able  to  run  the  firm  in  any 


How  does  the  Looking  Glass 
organizational  simulation  differ  from 
a  case  study?  A  lot  of  management 
data  is  in  the  material.  The  simulation 
is  so  realistic  that  data  generated 
usually  represent  the  participant's 
typical  work  behaviors.  As  in  real  life, 
the  job  is  done  based  on  people’s 
knowledge,  skills  and  abilities,  and 
from  what  they  find  out.  Problems 
become  apparent  through  the  various 
forms  of  communciations. 


Next,  participants  complete  ques¬ 
tionnaires  to  provide  additional  in¬ 
sights  regarding  how  they  ran  the  cor¬ 
poration,  what  they  knew,  who  they 
worked  with,  and  v  hat  problems  they 
worked  on.  Participants  now  adjourn 
to  their  divisions  to  discuss  Looking 
Glass  experiences. 


During  the  simulation,  faculty 
facilitators  have  unobtrusively  ob¬ 
served  what  is  happening.  The 
facilitators  help  the  participant 
reconstruct,  and  assess  what  hap¬ 
pened  during  the  simulation.  Ex¬ 
changes  following  are  the  heart  of  the 
learning  process.  Participants  are  able 
to  discuss  and  reconstruct  what  took 
place,  activities  they  initiated,  what 
they  were  thinking  about  when  they 
took  an  action,  or  how  another 
manager's  words  or  actions  affected 
their  behavior.  Like  an  onion,  simula¬ 
tion  events  are  unpeeled,  layer  by 
layer.  This  leads  an  individual  to  see 
how  his  or  her  managerial  style 
worked,  and  how  it  affected  other  par¬ 
ticipants.  Recalling  his  Looking  Glass 
experience,  Colonel  Bruce  M.  Garnett, 
USA,  said  being  able  to  see  group 
dynamics  in  operation  and  get  timely 
feedback  "made  this  a  very  useful  ex¬ 
perience  for  me  and,  if  given  the  op¬ 
portunity,  I  would  participate  again." 


The  information  is  not  laid  out 
neatly  as  might  be  the  case  where  all 
participants  start  with  the  same 
material.  While  both  may  hint  at  a 
division  or  corporate  problem  at  hand 
or  in  the  process  of  developing,  the 
simulation  has  real  work  to  do.  When 
that  work  is  done,  additional  work  is 
created  as  the  simulation  moves  ahead. 
This  is  far  different  than  the  question- 
discussion  mode  which  predominates 
the  case  method.  Also,  Looking  Glass 
requires  elaborate  "classroom"  space, 
and  has  a  high  teacher-to-student  ratio. 


The  Looking  Glass  simulation 
allows  the  participant  to: 


-Do 

-Look 

-Think 

-Grow. 


Looking  Glass  began  its  development 
in  1976  when  the  Center  for  Creative 
Leadership  received  a  3-year  contract 
from  the  Office  of  Naval  Research  to 
observe  managerial  behavior,  and 
assess  differences  between  effective  and 
ineffective  managerial  performance. 
When  participants  clamored  for 
knowledge  of  how  well  they  did,  a 
feedback  component  was  added.  This 
lead  to  the  current  simulation  which 
has  been  widely  accepted.  With  more 
than  480  runs,  the  number  of  par¬ 
ticipants  is  approaching  10,000. 


Public  and  private  sector  organiza¬ 
tions  have  used  Looking  Glass  for: 


—  Self  assessment 
— Team  building 

—  Analysis  of  training  needs 
— Network  building 


(See  LOOKING  GLASS,  pope  81) 
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(Second  of  Series  on  Acquisition 
Management  Productivity) 

Dr.  Andrew  P.  Mosier 


s  we  look  toward 
the  future  after 
celebrating  the  bicentennial 
of  our  constitution,  the 
budget  deficit  and  Gramm- 
Rudman-Hollings  (GRH) 
legislation  seem,  at  first,  to 
require  us  to  choose  among 
three  alternatives,  all 
negative.  Either  reduce  the 
appropriations  that  provide 
for  the  common  defense — 
and  risk  not  maintaining  an  adequate  defense;  or  reduce  ap¬ 
propriations  for  vital  domestic  programs— and  "demote"  the 
general  welfare;  or  reduce  both — and  endanger  our  freedom 
and  our  well-being.  There  is,  however,  a  positive  choice: 
Increase  productivity  substantially  in  management  of 
defense  acquisitions — and  provide  adequate  common 
defense  and  promote  domestic  well-being. 

By  "substantially,"  I  mean,  perhaps,  doubling  produc¬ 
tivity  or  increasing  it  at  least  to  the  level  believed  possible 
by  President  Reagan's  Blue  Ribbon  Commission  on  Defense 
Management  (hereafter  referred  to  as  President's  Commis¬ 
sion).  It  notes  that  many  accept  the  10-15  year  acquisition 
cycle  as  normal,  even  inevitable,  but  states,  "We  believe  that 
it  is  possible  to  cut  this  cycle  in  half.1 

Key  to  Productivity 

Achieving  such  a  substantial  increase  in  productivity  can¬ 
not  be  achieved  by  piecemeal  improvements.  It  requires 
broadly  based  action:  to  improve  and  integrate  major 
DSAM  (defense  system  acquisition  management)  processes; 
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to  develop  a  more  construc¬ 
tive  defense  acquisition  en¬ 
vironment;  and  to  improve 
DSAM  knowledge  and  in¬ 
formation  aids  for  managing 
integrated  processes  more 
productively  in  a  construc¬ 
tive  acquisition  environ¬ 
ment. 

Managing  acquisition  of 
defense  systems  needed  to 
support  national  military 
strategy  is  a  complex  process,  a  hierarchy  of  many  dynamic 
and  interdependent  subprocesses.  These  DSAM  sub¬ 
processes  interact  within  and  with  the  complex  defense  ac¬ 
quisition  environment  which  helps  shape  the  defense 
management  culture. 


At  the  apex  of  the  hierarchy  is  the  process  of  establishing 
national  security  objectives  and  formulating  the  national 
military  strategy.  This  long-range  strategy  should  be  the 
strategy  that  best  attains  the  national  security  objectives 
within  the  constraints  of  expected  resources.  Unfortunately, 
this  ideal  has  not  been  achieved.  The  President's  Commis¬ 
sion  found  that  the  long-term,  5-year  fiscal  planning 
guidance  for  strategic  defense  is  affected  by  changeable  near- 
term  factors  in  the  environment  of  defense  systems  acquisi¬ 
tion;  i.e.,  the  previous  years  congressional  decisions  and  the 
current  budget  debate  in  the  Congress.  These  induce  in¬ 
stability  into  the  long-range  planning  process.  The  Commis¬ 
sion  found  that  the  Administration  and  the  Congress  induce 
more  instability  in  the  budgeting  process.2 


42 


May-June  1988 


Acquisition  programs  bear  the  brunt 
of  this  fiscal  instability,  since  acquisi¬ 
tion  of  defense  systems  takes  more  of 
the  discretionary  part  of  the  defense 
budget.  The  problem  is  exacerbated  by 
GRH  legislation.  Thus,  at  the  apex  the 
DSAM  process  starts  behind  a  funding 
instability  "eight  ball"  in  a  troubled 
defense  acquisition  environment. 

Below  the  apex  the  DSAM  process 
continues  down  through  the  interac¬ 
tive  processes  of  determining  the  needs 
and  affordability  for  the  hundreds  of 
different  systems  required  to  perform 
the  missions  which  support  the  long- 
range  military  strategy.  The  process 
twines  through  the  interdependent  pro¬ 
cesses  of  planning,  programming, 
budgeting,  and  allocating  funds  at  all 
levels,  through  research,  intelligence, 
needs  determination,  congressional 
liaison,  and  oversight  processes;  and 
through  contracting,  designing, 
developing,  testing,  procuring,  pro¬ 
ducing,  provisioning,  training,  and 
other  processes  to  field  each  system  re¬ 
quired  to  perform  the  missions.  The 
DSAM  process  continues,  through 
proc  -?sses  of  modernizing  and  extend¬ 
ing  the  life  of  useful  systems,  or  selec¬ 
tively  replacing  obsolete  systems,  in 
support  of  the  current  national  military 
strategy. 

Many  thousands  of  DSAM 
professionals3  are  required  to  ac¬ 
complish  these  intertwined  DSAM 
processes.  Increasing  productivity  of 
these  professionals,  working  at  all 
levels  in  the  Executive  Branch,  the 
Congress,  the  defense  industry,  other 
businesses  and  academia,  is  the  key  to 
achieving  substantial  increases  in  pro¬ 
ductivity  in  defense  systems  acquisi¬ 
tion.  If  we  focus  on  improvements  that 
will  significantly  increase  productiv¬ 
ity  of  these  DSAM  professionals,  we 
can  achieve  substantial  cumulative  in¬ 
creases  in  the  productivity  of  all  ac¬ 
quisition  organizations.  This  would  in¬ 
crease  productivity  in  defense  systems 
acquisition  substantially. 

Questions  of  Sufficiency 

Maintaining  our  defenses  in  this 
dynamic  world  requires  increasingly 
complex  defense  systems.  Acquiring 
systems  that  are  superior  and  afford¬ 
able,  in  turn,  requires  DSAM  pro¬ 
cesses  that  are  increasingly  complex 
and  more  productive.  Getting  ahead  in 
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this  race— between  the  complexity  of 
defense  systems  and  the  productivity 
of  management  processes — requires 
continual  improvement  in  the  pro¬ 
cesses  and  the  environment  of  defense 
acquisition  and,  particularly,  improve¬ 
ment  in  aids  to  increase  productivity 
of  DSAM  professionals. 

To  this  end,  we  should  review  past 
DSAM  approaches  and  im¬ 
provements,  seeking  to  identify  proven 
successes  and  past  insufficiencies, 
judging  whether  or  not  each  approach 
or  improvement  increased  productiv¬ 
ity  substantially.  To  get  ahead,  we 
must  use  results  from  this  research  in 
a  broad  three-pronged  endeavor: 

— To  continue  successful  approaches 
and  build  upon  proven  successes 
— To  remedy  past  insufficiencies  that 
are  correctable 

— To  find  out  how  to  cope  better  with 
insufficiencies  or  problems  inherent  in 
complex  DSAM  processes  and  in  the 
environment  of  defense  acquisition. 

The  ominous  shadow  cast  across  our 
future  by  the  tremendous  federal 
deficit,  and  by  threats  of  more  ar¬ 
bitrary  defense  budget  cuts  generated 
by  GRH  legislation  and  the  new  INF 
Treaty  environment,  demands  concen¬ 
tration  on  improvements  which  will  be 
sufficient;  i.e.,  which  will  increase  pro¬ 
ductivity  substantially.  We  can  no 
longer  afford  to  throw  money  at  na¬ 
tional  problems,  including  maintaining 
adequate  defense.  A  main  payoff  of 
future  improvement  in  acquisition 
management  must  be  increased  defense 
acquisition  productivity.  This  new 
criterion  requires  asking  hard  ques¬ 
tions  about  every  prospective  manage¬ 
ment  improvement;  Is  it  sufficient  to 
increase  productivity  substantially? 
What  related  actions  will  boost  pro¬ 
ductivity  even  more? 

In  applying  the  criterion  we  must 
focus  on  the  key  to  productivity— 
DSAM  professionals  throughout  the 
acquisition  community.  Our  objective 
must  be  to  select,  integrate  and  imple¬ 
ment  management  improvements  and 
aids  which  are  sufficient  to  increase 
productivity  of  DSAM  professionals 
substantially — individually  and  collec¬ 
tively  in  organizational  and  multi- 
organizational  DSAM  subprocesses. 


Productivity  Review 

Faced  with  current  world  political 
and  national  financial  conditions  and 
the  present  state  of  defense  acquisition, 
we  must  search  for  new  ideas  and  con¬ 
cepts  to  substantially  increase  produc¬ 
tivity  in  DSAM  processes.  In  my  first 
article,  I  described  problems  conse¬ 
quent  to  the  inherent  large  scope,  com¬ 
plexity  and  "interactiveness"  of  the 
DSAM  process.  I  proposed  a  frame¬ 
work  for  analyzing  management  im¬ 
provements  and  identifying  new  op¬ 
portunities  to  increase  productivity  of 
DSAM  professionals.  The  framework 
included  five  elements;  three  tradi¬ 
tional  organizational  elements  (objec¬ 
tives,  processes  and  structures)  and 
two  types  of  acquisition  process  inputs 
(tangible  resources,  and  intangible  job- 
and  task-related  DSAM  knowledge 
and  information  resources).4 

The  Final  Report  of  the  President’s 
Commission  supports  the  addition  of 
a  sixth  element  to  this  framework.  The 
serious  destabilizing  consequences  of 
present  national  planning  and 
budgeting  processes  (cited  above  from 
the  Commission's  report)  and  "the  in¬ 
creasingly  troubled  relationship  be¬ 
tween  the  defense  industry  and  govern¬ 
ment"  (emphasized  by  the  Commission 
as  meriting  greatest  concern)5  are 
strong  evidence  that  all  endeavors  to 
increase  productivity  must  consider 
environment  and  culture  of  defense  ac¬ 
quisition  management  as  the  sixth  ele¬ 
ment  of  the  productivity  framework. 

I  have  used  the  first  three  elements 
of  this  framework  to  research  past  ef¬ 
forts  to  improve  management  of  ac¬ 
quisitions,  organizing  results  according 
to  the  traditional  organizational 
elements.  Under  each  organizational 
element,  I  tried  to  identify  three  things: 
successful  approaches  to  continue  and 
build  upon;  insufficiencies — oversight 
failures,  inadequacies,  and  inabil¬ 
ities— which  must  either  be  remedied 
or  coped  with  better  to  increase 
defense  acquisition  productiv¬ 
ity  substantially;  and  crucial 
underlying  issues  which  must  be  ad¬ 
dressed  to  assure  steady  progress  in  in¬ 
creasing  DSAM  productivity. 

History  shows,  however,  that 
substantial  increases  in  productivity 
have  come  through  innovative  applica¬ 
tion  of  new  ideas,  concepts  and 
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technologies  to  current  problems,  not 
through  more  intensive  application  of 
traditional  practices.  So,  I  have  also 
been  using  the  last  two  elements  of  the 
framework  to  focus  my  research  and 
help  identify  new  innovative  ways  to 
significantly  improve  the  DSAM 
process. 

This  article  summarizes  selected  ex¬ 
amples,  findings  and  conclusions  of  the 
first  part  of  my  research,  with 
numerous  references  for  more  informa¬ 
tion.  My  purpose  is  to  provide  a  foun¬ 
dation  for  considering  the  last  two 
elements  of  the  framework — DSAM 
knowledge  and  information  aids,  and 
the  environment  and  culture  of  defense 
acquisition — in  more  intensive  future 
explorations  of  new  ideas  for  substan¬ 
tially  increasing  the  productivity  of 
DSAM  professionals. 

Objectives  and  Strategy 

Consider  the  first  element  of  the 
framework:  each  organization's  objec¬ 
tives,  priorities,  constraints,  and 
strategy.  The  concept  of  acquisition 
strategy  to  cope  with  the  complex 
organizational  objectives  problem  has 
been  evolving  for  more  than  a  decade. 
The  general  problem  is  how  to  focus 
job  actions  in  each  organization  of  the 
organization's  objectives,  but  within 
the  framework  of  the  hierarchy  of 
defense  acquisition  objectives, 
priorities,  resources,  constraints  and 
policies. 

The  Office  of  Management  and 
Budget  (OMB)  issued  Circular  A-109 
in  1976  to  establish  government-wide 
policy  for  acquiring  major  systems.  Its 
cornerstone  was  policy  to  tailor  ac¬ 
quisition  strategies  for  procuring  all 
new  systems.  This  policy  was  transmit¬ 
ted  down  through  DOD  Directive 
5000.1  and  DOD  Instruction  5000.2  in¬ 
to  military  service  regulations.  There 
was  no  common  working  definition  of 
"acquisition  strategy,"  or  a  consistent 
agreement  on  its  structure  and  com¬ 
position  during  tailoring. 

Four  years  ago,  the  Defense  Systems 
Management  College  (DSMC)  tackled 
these  problems.  It  assembled  informa¬ 
tion  about  acquisition  strategy  and 
published  the  Acquisition  Strategy 
Guide,  which  addresses  the  "what?" 
"why?"  "when?”  of  acquisition 
strategy,  and  the  "how?"  "who?" 
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"where?"  of  its  development,  execution 
and  modification.  It  presents  13  alter¬ 
natives/issues  for  tailoring  an  acquisi¬ 
tion  strategy  to  a  particular  program's 
requirements  and  objectives.  The 
Guide  offers  a  comprehensive 
framework  for  structuring,  devel¬ 
oping,  and  executing  an  acquisition 
strategy  in  accordance  with  Depart¬ 
ment  of  Defense  guidance.  Discussing 
the  definition  of  acquisition  strategy, 
the  Guide  states:  "A  specific 
framework  is  needed  for  planning, 
directing,  and  managing  the  program. 
The  acquisition  strategy  encompasses 
program  objectives,  direction,  and 
control  through  the  integration  of 
strategic,  technical  and  resource  con¬ 
cerns."6  It  defines  and  explains  these 
terms  and  their  relationships. 


v  j  onsidering 
limitations  inherent  in 
the  DSAM  process, 
shouldn’t  higher 
priority  be  given  to 
developing  aids  pro¬ 
viding  faster,  easier 
and  selective  access? 


Ideally,  the  acquisition  strategy:  (1) 
is  designed  at  the  outset  of  a  program, 
clearly  stating  the  program's  objec¬ 
tives,  and  providing  an  organized  and 
consistent  approach  to  meeting  these 
objectives  within  known  constraints, 
including  higher-level  objectives  and 
priorities,  and  approved  resources;  and 
(2)  is  updated  throughout  the  program 
as  more  information  is  acquired. 

Not  Sufficient 

Development  of  this  concept  of 
strategy  has  proved  sound,  but  this  has 
not  been  sufficient.  The  DSAM  profes¬ 
sionals  must  apply  it  more  effectively 
to  increase  defense  acquisition  produc¬ 
tivity  substantially. 


Published  guides  always  will  be 
essential  and,  until  recently,  had  no 
alternative;  but,  all  published  guides 
have  inherent  limitations.  For  example, 
ephemeral  information  in  the  1984 
Guide,  particularly  "who''  and 
"where,"  began  to  obsolesce  im¬ 
mediately  after  publication.  Further¬ 
more,  newer  alternatives/issues 
developed  for  tailoring  an  acquisition 
strategy  (e.g.,  the  recently  published 
Evolutionary  Acquisition:  An  Alter¬ 
native  Strategy  for  Acquiring  Com¬ 
mand  and  Control  2  Systems7  are  not 
referenced  in  the  earlier  Guide. 

Even  if  DSAM  professionals  suc¬ 
cessfully  locate  all  useful  "how  to" 
guidance,  a  more  serious  insufficiency 
limits  their  productivity.  The  DSAM 
professionals  continually  require  many 
items  of  specific,  current,  relevant, 
general  DSAM  knowledge  and  infor¬ 
mation  (e.g.,  policies,  direction, 
reports,  feedback,  how-to,  lessons- 
learned)  that  are  applicable  to  all  or 
many  programs  and  process  functions. 
Specifically,  professionals  need  such 
generally  applicable  information  to 
design  implement  and  update  acquisi¬ 
tion  strategy  decisions  for  continued 
"integration  of  strategic,  technical,  and 
resource  concerns"  of  the  organization. 
No  published  guide  can  provide  more 
than  a  small  fraction  of  this  kind  of 
general  DSAM  knowledge  and  infor¬ 
mation,  and  this  fraction  may  be  cur¬ 
rent  only  on  the  publication  date. 

All  professionals,  using  present  in¬ 
adequate  DSAM  knowledge  and  infor¬ 
mation  aids,  waste  time  searching  in¬ 
efficiently  for  specific  DSAM 
knowledge  and  information  that  each 
requires  in  his/her  job  and  tasks;  they 
also  lose  opportunities  when  available 
relevant  information  is  not  found. 

Considering  limitations  inherent  in 
the  present  DSAM  process,  shouldn't 
higher  priority  be  given  to  developing 
aids  that  provide  faster,  easier  and 
selective  access  to  particular  relevant 
DSAM  knowledge  and  information  by 
DSAM  professionals,  whenever  they 
require  it?  Such  DSAM  knowledge  and 
information  aids  would  increase 
substantially  the  productivity  of 
DSAM  professionals  and  their 
organizations. 
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Another  critical  insufficiency  has 
seriously  limited  productivity — the 
failure  of  policy-makers  to  require  all 
organizations  involved  in  acquisition 
management  to  maintain  and  use 
organization  strategies.  Policy-makers 
Tiled  to  «ee  the  ceneralitv  and  power 
of  the  concept  of  strategy  to  solve  the 
complex  objectives  problems  of  all 
organizations.  Other  organizations 
than  those  acquiring  a  system  can 
benefit  from  using  an  organization 
strategy.  The  President's  Commission 
recommended  essentially  that  this 
strategy  concept  be  applied  by 
organizations  at  highest  levels  of  the 
Administration  to  establish  national 
security  objectives  and  a  national 
military  strategy  to  achieve  the 
security  objectives.8 

Department  of  Defense  policy 
should  require  every  DOD  organiza¬ 
tion  involved  in  defense  acquisition  to 
use  the  strategy  concept  to  relate  its 
objectives,  priorities,  constraints  and 
policies,  and  those  of  higher-level 
DOD  and  external  organizations.  It 
should  require  each  organization  to 
develop  an  organization  strategy 
which,  within  the  organization's  ex¬ 
pected  resources,  best  supports  na¬ 
tional  military  strategy.  Then,  DSAM 
professionals  in  each  organization 
could  use  their  organization  strategy  in 
decentralized  execution  of  DSAM  pro¬ 
cesses  to  achieve  the  organization's  and 
higher-level  objectives  in  accordance 
with  all  applicable  policies. 

Program  stability  and,  thus,  defense 
acquisition  productivity  would  be  in¬ 
creased  substantially  by  explicit  ap¬ 
plication  of  the  strategy  concept  by 
every  organization  involved  in  the 
hierarchy  of  defense  acquisition — from 
the  National  Security  Council  (NSC) 
in  the  apex  down  to  each  pro¬ 
gram/project  office  (PMO)  managing 
the  acquisition  of  a  system,  and  to  each 
organization  that  oversees  or  supports 
PMOs. 

This  would  help  the  Administration 
provide  a  more  stable  framework 
within  which  system  acquisition 
strategies  could  be  developed  and  im¬ 
plemented  to  support  the  long-range 
national  military  strategy.  In  turn,  this 
would  contribute  to  moving  the 
DSAM  process  from  behind  the 
budgeting  and  funding  instability 
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"eight  ball/'  which,  alone,  should 
enable  tremendous  increases  in  pro¬ 
ductivity  of  the  DSAM  process. 

Then,  in  a  more  constructive  ac¬ 
quisition  environment,  the  Congress 
could  debate  and  negotiate  with  the 
P;jsident  concerning  national  securi¬ 
ty  objectives  and  national  military 
strategy  (and  other  national  strategies, 
diplomatic  and  domestic)  to  achieve 
the  objectives,  instead  of  microman¬ 
aging  line-items  of  defense  budgets. 

The  potential  of  this  constructive 
change  in  the  defense  acquisition 
environment — focusing  congressional 
attention  on  national  military  objec¬ 
tives  and  strategies  instead  of  budget¬ 
line  items — is  enormous  for  reducing 
tremendous  waste  and  increasing  pro¬ 
ductivity  substantially  in  defense 
system  aquisition.  There  would  be  less 
time  and  temptation  for  members  of 
the  Congress  to  "deal  with  defense 
issues  mainly  in  terms  of  currying 
favor  with  their  constituents,"  as 
former  Senator  Barry  Goldwater  feels 
many  do.  He  believes  that,  "As  a  con¬ 
sequence,  Congress,  in  the  aggregate, 
syphons  off  billions  of  dollars  every 
year  from  modernization  programs 
and  military  payroll  by  keeping  open 
no-longer-needed  bases  and  facilities 
and  by  foisting  unneeded  and  un¬ 
wanted  weapon  systems  on  the 
Pentagon."9 

This  example  of  the  power  of  only 
one  constructive  change  in  the  acquisi¬ 
tion  environment  emphasizes  another 
serious  insufficiency— failure  through 
passive  acceptance  of  the  present  en¬ 
vironment  to  establish  acquisition  ob¬ 
jectives  concerning  the  sixth  element  of 
the  productivity  framework.  The 
Department  of  Defense  should 
establish  an  objective  to  "manage" 
changes  in  the  defense  acquisition  en¬ 
vironment  and  culture— changes  that 
would  allow  and  support  substantial 
increases  in  acquisition  management 
productivity. 

In  summary,  past  directed  acquisi¬ 
tion  improvement  efforts  in  the  objec¬ 
tives  and  strategy  element,  have  not 
been  sufficient  due  to: 

—Lack  of  effective  aids  to  help  DSAM 
professionals  get  specific  relevant 
DSAM  knowledge  and  information 
whenever  they  need  it  to  design,  up¬ 


date,  and  implement  an  acquisition 
strategy;  or  to  oversee  and  support  im¬ 
plementation  of  several  defense  system 
acquisition  strategies 

—Failure  to  recognize  the  generality  of 
the  strategy  concept,  and  require  that 
every  organization  involved  in  defense 
acquisition  develop,  maintain  and  im¬ 
plement  an  organization  strategy 
which  best  supports  the  National 
Military  Strategy  within  available 
resources 

— Failure  to  establish  a  defense  objec¬ 
tive  to  manage  constructive  changes  in 
the  environment  of  defense  systems  ac¬ 
quisition  so  that  high-level  government 
and  public  attention  is  focused  more 
on  national  military  objectives  and 
strategies,  and  less  on  budget-line 
items. 

Organizational  Processes 

Consider  next,  the  second  produc¬ 
tivity  element:  systematic  organiza¬ 
tional  DSAM  processes  and  sub¬ 
processes  used  to  achieve  the  organiza¬ 
tion's  and  higher-level  objectives. 
These  processes  and  subprocesses  func¬ 
tion  as  highly  interactive  elements  of 
the  whole  defense  systems  acquisition 
process.  They  operate  in  a  dynamic  en¬ 
vironment  of  constantly  advancing 
technologies,  and  of  ever- changing  na¬ 
tional  and  world  political  and 
economic  conditions. 

Ideally,  these  DSAM  processes 
should  function  in  six  levels  or  areas: 

— To  establish  national  military 
strategy  within  the  framework  of  na¬ 
tional  security  objectives,  and  within 
resources  allocated  and  planned  in  a 
provisional  five-year  defense  budget 
—To  select  and  support  DOD  pro¬ 
grams  for  acquiring  all  systems  needed 
to  carry  out  the  military  strategy 
— To  develop  an  achievable  acquisi¬ 
tion  strategy  for  each  system  acquisi¬ 
tion  program 

—To  develop  organization  strategies 
for  all  other  "non-program"  DOD 
organizations  involved  in  defense  ac¬ 
quisition  (e.g.,  that  develop  acquisition 
policy,  or  that  oversee  or  support  more 
than  one  system  acquisition  program) 
— To  support  decentralized  implemen¬ 
tation  of  acquisition  strategies  of  all 
system  acquisition  programs  and 
organization  strategies  of  all  "non¬ 
program"  organizations  and,  thus,  im- 
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plement  national  military  strategy  to 
achieve  national  security  objectives 
which  the  military  strategy  supports 
— To  adjust  any  of  the  above  interac¬ 
tive  elements  (below  the  long-range  na¬ 
tional  military  strategy  apex)  as  need¬ 
ed  so  that  thev  function  together  as  an 
integrated  productive  defense  acquisi¬ 
tion  process. 

Ideally,  these  functional  DSAM  pro¬ 
cesses  should  be  fully  integrated  within 
constraints  of  the  current  provisional 
five-year  defense  budget.  Together, 
processes  should  support  each  organi¬ 
zation's  integration  of  its  strategic, 
technical  and  resource  concerns.  They 
should  help  integrate  strategy  and 
operations  of  every  organization,  all 
constraining  hierarchical  concerns  and 
priorities,  and  all  applicable  policy 
guidance  from  the  Executive  Branch 
and  the  Congress,  Defense  Depart¬ 
ment,  and  respective  military  services. 

Unfortunately,  neither  ideal  has 
been  achieved.  Concerning  the  func¬ 
tional  process  ideal,  present  defense  ac¬ 
quisition  processes  usually  support 
mainly  the  second  and  third,  and  part 
of  the  fifth  function. 

The  first  function— establishing  a 
resource  constrained  national  military 
strategy  (which  can  be  used  to  develop 
more  realistic  and  stable  defense  ac¬ 
quisition  programs  and  budgets) — 
cannot  be  performed  well  until  the 
following  recommended  PPBS  pro¬ 
cesses  are  developed  and  integrated.  In 
June  1986,  the  President's  Commission 
recommended:  that  the  Joint  Chiefs  of 
Staff  (JCS)  develop  the  first  national 
military  strategy  with  5-year  fiscal  con¬ 
straints:  that  a  Presidential  decision 
selecting  a  national  defense  program 
include  5-year  fiscal  guidance  and 
2-year  budget  guidance;  and  that  the 
Congress  use  national  military  strategy 
as  a  basis  for  reviewing  the  defense 
program  and  budget.10  The  Ad- 
ministrtion  has  begun  to  prepare 
2-year  defense  budgets,  but  the  Con¬ 
gress  apparently  intends  to  continue  its 
1-year  budget  reviews.  Even  if  the 
three  recommendations  were  fully  ac¬ 
cepted  and  full  implementation  began, 
successful  implementation  could  take 
several  years  because  the  present 
DSAM  information  base  may  not  ade¬ 
quately  support  the  whole  first 
function. 
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Regarding  the  fourth  function,  pre¬ 
sent  DOD  policy  does  not  require 
every  organization  involved  in  the 
DSAM  process  to  develop,  maintain 
and  use  an  organization  strategy  to 
coordinate  and  achieve  its 
objectives — only  those  organizations 
which  manage  the  acquisition  of  a 
defense  system.  Finally,  successful  per¬ 
formance  of  the  sixth  function  depends 
on  regular  effective  performance  of  all 
five  other  functions. 


ike  the  fabled 
blind  men  touching 
an  elephant, 
everybody  in  defense 
acquisition  com¬ 
prehend  DSAM  pro¬ 
cesses  that  each 
'touches1  in  compart- 
mented  activities. 


Concerning  the  DSAM  process  in¬ 
tegration  ideal,  overall  progress  in  in¬ 
tegrating  DSAM  organizational  pro¬ 
cesses  and  subprocesses  during  the  past 
40  years  has  been  slow  because  of  the 
large  scope  and  complexity  of  the 
whole  DSAM  process.  Like  the  fabled 
Indian  blind  men  touching  an 
elephant,  everybody  in  defense  ac¬ 
quisition  comprehend  mainly  the 
DSAM  subprocesses  that  each 
"touches"  in  his/her  organizationally 
compartmented  acquisition  activities. 
Few  can  "see"  across  boundaries  of 
larger  DSAM  processes  well  enough  to 
anticipate  disruptive  interactions  that 
will  result  from  first  attempts  to  in¬ 
tegrate  the  processes;  thus,  much  error 
in  past  trial-and-error  improvements. 
Serious  failures  "see"  and  recognize 
critical  needs  for  change  until 
something  (e.g  ,  "horror”  stories  of 
alleged  mismanagement)  forcefully 
demonstrates  that  a  corrective  action 
is  overdue. 


Nevertheless,  a  few  major  organiza¬ 
tional  processes  that  transcend  func¬ 
tional  areas  and  organizational  boun¬ 
daries  have  been  developed  which  help 
managers  increasingly  intergrate  ma¬ 
jor  DSAM  processes  and  their  func¬ 
tional  subprocesses.  During  the  past  30 
years,  I  personally  observed  the 
following  examples  which  provide 
useful  lessons  for  future  emulations. 

Robert  S.  McNamara,  appointed 
Secretary  of  Defense  by  President  John 
F.  Kennedy  in  January  1961  and 
retained  by  President  Lyndon  B. 
Johnson,  directed  development  of  the 
planning,  programming,  and  bud¬ 
geting  system  (PPBS).  The  PPBS  was 
to  coordinate  and  control  all  strategic 
planning  and  resource  management 
processes  in  the  Department  of 
Defense.  One  of  its  important  uses  for 
defense  acquisition  today  is  to  plan, 
program,  budget  and  allocate  all  funds 
for  acquiring  and  moderninizing 
defense  systems. 

The  new  PPBS  was  a  major  change 
from,  not  an  evolutionary  develop¬ 
ment  of,  past  DOD  management  prac¬ 
tice.  Its  initial  development  throughout 
the  1960s  was  guided  by  new  and  well- 
researched  theoretical  concepts  and 
analyses  documented  initially  in  two 
complementary  classics:  The 

Economics  of  Defense  in  the  Nuclear 
Age,  and  Planning  and  Control 
Systems:  A  Framework  for 

Analysis . 11  Their  respective  authors, 
Charles  J.  Hitch  and  Robert  N. 
Anthony,  were  management  profes¬ 
sionals  in  academia.  They  were  se¬ 
quentially  appointed  by  Secretary 
McNamara  as  Assistant  Secretary  of 
Defense,  Comptroller  (February  1961 
through  July  196 8)  to  adapt  and  imple¬ 
ment  in  the  PPBS  and  related  manage¬ 
ment  systems,  many  management 
theories  and  concepts  presented  ini¬ 
tially  in  their  books. 

David  Packard,  appointed  Deputy 
Secretary  of  Defense  by  President 
Richard  M.  Nixon,  quickly  instituted 
the  Defense  System  Acquisition 
Review  Council  (DSARC)  in  May 
1969.  The  DSARC  (now  known  as  the 
DAB,  Defense  Acquisition  Board),  led 
the  great  departure  from  DOD 
management  practice  of  total  package 
procurement  in  the  McNamara  era. 
Drawing  on  his  successful  experience 
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in  civilian  high-tech  product  develop¬ 
ment,  Mr.  Packard  directed  a  major 
change  in  processes  for  acquiring  ma¬ 
jor  systems  (including  fly-before-buy 
testing)  by  issuing  the  first  DOD  Direc¬ 
tive  5000.1,  "Acquisition  of  Major 
Defer,;?  System;."  July  13,  1971. 

These  are  examples  of  past  successes 
we  should  emulate  by  searching  for 
opportunities  to  integrate  other  major 
DSAM  processes  and  their  functional 
subprocesses;  and,  to  build  upon  with 
continued  improvements  to  increase 
substantially  the  productivity  of 
DSAM  professionals. 

It  is  important  to  recognize  that  the 
highly  successful  PPBS  and  DSARC  ef¬ 
forts  to  increasingly  integrate  major 
DSAM  processes  were  based  on  a  well- 
thought-out  and  comprehensive  new 
theory,  not  on  evolutionary  im¬ 
provements  in  defense  management 
practices.  Many  practical  DOD 
managers  entrenched  in  functional 
subprocesses  resisted  both  initiatives. 
Fortunately,  these  efforts  to  integrate 
major  DSAM  processes  were  both  in¬ 
stituted  successfully  before  a  new  Ad¬ 
ministration  could  appoint  new  policy¬ 
makers  with  different  improvement 
perceptions.  (This  issue  will  be  ad¬ 
dressed  below  as  "Change  Triggers.") 
Now  enhanced  by  continued  im¬ 
provements  in  the  cost-  and  schedule- 
oriented  PPBS,  and  in  the 
performance-oriented  process,  they 
have  substantially  increased  produc¬ 
tivity  in  acquisition  management. 
However,  substantial  progress  in 
integrating  the  PPBS  and  the  DSARC 
has  been  elusive. 

Now,  after  another  16  years,  a  third 
major  change  (recommended  by  the 
President's  Commission)  promises  to 
enhance  the  process  capability  through 
better  integration  with  the  PPBS.  The 
change  promises  a  mechanism  for 
challenging  stated  user  requirements 
for  a  new  system  through  informed 
user-aided  trade-offs  between  stated 
performance  requirements  on  one 
hand,  and  schedule  and  cost  on  the 
other.  This  change  involved  replacing 
the  DSAP.C  with  a  restructured  Joint 
Resources  Management  Board 
(!RMB).I2Today  it  is  the  Defense  Ac¬ 
quisition  Board  (DAB). 
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Deputy  Secretary  of  Defense 
William  H.  Taft  IV  began  to  imple¬ 
ment  this  important  recommendation 
June  3,  1986,  before  release  of  the 
Commission's  final  report.  He  replaced 
DSARC  with  a  restructured  JRMB  and 
directed  that  it  assume  expanded 
DSARC  capabilities,  including  ex¬ 
amining  trade-offs  between  system 
cost  and  performance.13  Full  im¬ 
plementation  of  the  Commission's 
recommendation  required  congres¬ 
sional  establishment  of  two  new  DOD 
positions  whose  responsibilities  would 
include  chair  and  vice  chair  of  the  new¬ 
ly  established  JRMB  (now  DAB). 
These  will  be  considered  below  as 
"Organizational  Structures." 

Change  Triggers 

I  have  discussed  successful  examples 
of  proven  successes  in  organizational 
processes  that  we  should  emulate  and 
build  upon.  Before  looking  at  major  in¬ 
sufficiencies,  however,  we  should 
pause  to  consider  major  issues  of 
organizational  change,  and  of  problem 
discontinuities  that  have  impeded  pro¬ 
gress  in  substantially  increasing 
organizational  productivity.  If  we 
understand  the  issues  and  recognize 
causes  of  discontinuities,  we  can  bet¬ 
ter  understand  sources  of  the  insuffi¬ 
ciencies  and  judge  what  should  be  done 
to  remedy  them  or  to  cope  better. 

The  large  complex  interactive 
DSAM  process  has  many  management 
issues  and  problems  that  need  resolu¬ 
tions,  each  an  appropriate  focus  for 
new  acquisition  improvement  in¬ 
itiatives.  Many  are  long-standing, 
since  the  solution  of  a  complex  pro¬ 
blem  from  one  perspective  often  ap¬ 
pears  as  an  unresolved  or  new  problem 
from  another  persepective.  Conse¬ 
quently,  most  ad  hoc  group  reports  of 
problems  and  recommended  solutions 
have  not  brought  a  feeling  of  steady 
progress,  but  rather  a  sense  of  deja  vu. 

Seeking  to  learn  from  history,  I  have 
considered  many  changes  made  to  im¬ 
prove  DSAM  processes  since  the  DOD 
was  established.  First,  I  tried  to  learn 
what  triggers  major  change  actions  in 
the  continuing  evolution  of  defense  ac¬ 
quisition  management  processes. 
Then,  what  determines  the  scope  of  a 
major  change,  and  what  determines  its 
content  and  emphasis.  And  finally, 
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how  t^e  frequency  of  new  major  ef¬ 
forts  for  change  effect  steady  improve¬ 
ment  of  the  DSAM  process. 

I  found  three  main  triggers.  All  are 
perceptions  of  influential  people  em¬ 
powered  or  activated  by  events,  either 
by  successions  of  policy-makers,  or  by 
reports  of  policy-makers,  or  by  reports 
of  alleged  fraud  or  mismanagement. 
The  main  triggers  are: 

— New  perceptions  (of  the  most  critical 
national  and  DSAM  issues  and  how  to 
handle  those  issues)  resulting  from 
changes  of  Administrations  appointing 
new  top  defense  policy-makers  with 
new  different  perceptions 

—Adjusted  perceptions  (of  the  critical 
DSAM  processes  and  issues)  resulting 
from  change  during  an  Administration 
in  a  top  official  who  makes  or  strongly 
influences  acquisition  policy 

—Public  perceptions  (of  mismanage¬ 
ment  of  defense  acquisition)  pre¬ 
cipitated  and  re-enforced  by  media 
reports  of  alleged  fraud,  abuse  and 
mismanagement  of  DOD  weapon 
system  and  spares  acquisitions. 

I  found  that  the  scope  of  a  triggered 
change  depends  mainly  on  the  degree 
of  the  trigger's  influence.  Changes  of 
Administration,  which  often  bring 
quite  different  perceptions,  can  initiate 
significant  changes  in  DSAM  pro¬ 
cesses,  often  with  little  congressional 
involvement.  During  an  Administra¬ 
tion,  change  of  a  key  policy  official 
with  different  experience  and  percep¬ 
tions  often  adjusts  emphasis  or  adds 
new  initiatives  in  support  of  an  already 
established  defense  acquisition  course. 
Public  perceptions  of  acquisition 
mismanagement,  however,  tend  to  get 
the  Congress  actively  involved  with 
directive  and  enabling  legislation,  and 
cause  substantial  changes  in  DSAM 
organizational  processes  and  structure. 

On  the  other  hand,  the  specific  con¬ 
tent  and  emphasis  of  a  change  depends 
on  the  perceptions  of  the  actual 
change-maker(s),  including  the  Con¬ 
gress  when  enabling  or  directive 
legislation  is  involved.  When  the  Con¬ 
gress  gets  concerned,  a  mix  of  acquisi¬ 
tion  management  perceptions,  not  an 
integration,  may  shape  the  content  and 
emphasis  of  changes.  However, 
changes  may  be  shaped  by  shared 
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perceptions,  if  the  Congress  and  Ad¬ 
ministration  are  guided  by  the  same  in¬ 
tegrated  set  of  recommended  changes, 
as  they  were  for  parts  of  the  Commis¬ 
sion's  report.  Even  then,  public  percep¬ 
tions  may  influence  the  Congress  to 
tpoisUrp  additional  non-inteerated 


tance  of  defense  among  national  issues. 
All  new'  top  policy-makers  bring  new 
perceptions  of  the  most  crucial  DSAM 
issues  and  processes  in  defense  acquisi¬ 
tion,  and  of  how  to  handle  them. 
Results  have  been  frequent  shifts  in  the 
priority  of  defense  among  national 


The  Reagan  Administration's  early 
DOD  Acquisition  Improvement  Pro¬ 
gram  (AIP)  provides  an  example  of 
how  Administrations  can  expedite  in¬ 
itial  development  of  truer  perceptions. 
Then  Deputy  Secretary  of  Defense, 
Frank  C.  Carlucci  (now  the  Secretary 


possibly  counterproductive,  changes. 

Frequency  of  the  first  trigger,  new 
perceptions,  depends  on  whether  the 
President  is  elected  for  one  or  two 
terms.  Since  Dwight  D.  Eisenhower, 
there  have  been  six  Presidents;  none 
have  served  two  terms:  only  three — 
Johnson,  Nixon  and  Reagan — have 
served  longer  than  one  term.  The 
shorter  terms  have  increased  the  fre¬ 
quency  of  defense  acquisition  policy¬ 
maker  turnovers,  and,  thus,  of  new 
and  different  perceptions  of  the  most 
critical  DSAM  issues  and  how  best  to 
deal  with  them.  The  frequency  of  the 
second  trigger  is  much  higher  than 
change  of  Administrations.  The  fre¬ 
quency  of  the  third  has  been 
inu  casing,  prompted  by  more  frequent 
high-media  attention  to  defense  related 
problems. 

Together,  as  the  drivers  of  change, 
these  frequent  triggers  since  DOD  was 
established  have  brought  frequent, 
often  significantly  different,  percep¬ 
tions  of  the  key  DSAM  issues  and  of 
how  to  deal  with  them.  This  has  made 
DSAM  change  sporadic,  and  manage¬ 
ment  improvement  intermittent. 
Because  of  the  long  time  required  to  in¬ 
stitutionalize  new  initiatives  in  large 
bureaucracies,  good  DSAM  process 
improvement  initiatives  often  die  when 
another  trigger  sparks  new  and  dif¬ 
ferent  change  actions.  This  has  re¬ 
tarded  critically  needed  progress  in 
DSAM  process  improvement.  A  brief 
examination  of  past  effects  of  each  trig¬ 
ger  on  the  DSAM  process  will  provide 
useful  lessons  for  future  improve¬ 
ments. 

New  Perceptions 

A  change  of  Administrations  brings 
new  top  policy-makers  with  different 
experiences,  and  thus  different  percep¬ 
tions,  to  trigger  change.  Rotations  of 
political  party  (four  out  of  the  last  six 
changes  of  Administration)  bring 
policy-makers  with  different  phi¬ 
losophies  and  experience,  and,  thus, 
different  views  of  the  relative  impor- 
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issues,  and  frequent  changes  in  DSAM 
processes  to  cope  better  with  new 
perceptions  of  the  crucial  defense  ac¬ 
quisition  issues  and  major  problems. 


*  he  main  effect 
of  turnovers  of  key 
policy-makers  during 
an  Administration  is 
to  increase  frequency 
of  changes  in  percep¬ 
tions  disrupting  con¬ 
tinuity  guiding  long¬ 
term  improvements. 
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Too  often,  top  officials  in  new  Ad¬ 
ministrations  start  less  well  prepared 
than  did  Mr.  McNamara  and  Mr. 
Packard.  Each  did  his  homework. 
Each  was  prepared  with  well- 
developed  new  theories  and  concepts 
to  institute  big  changes  in  defense 
management  to  improve  it  signifi¬ 
cantly,  not  just  incremental  im¬ 
provements  in  current  practices  as 
needs  are  perceived. 

Always,  top  officials  in  a  new  Ad¬ 
ministration  start  without  a  good  cor¬ 
porate  memory  of  past  actions  on  the 
perennial  DSAM  issues  and  problems. 
Never,  do  they  find  much  organized 
information  relevant  to  each  major 
issue.  Usually,  there  is  substantial 
delay  while  the  new  policy-makers 
gather  essential  information,  decide 
which  problems  are  most  critical,  and 
act  to  remedy  or  cope  better  with  those 
problems.  Often,  Administrations 
have  ended  before  late  initiatives  were 
institutionalized. 
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of  Defense),  quickly  identified  many 
needed  actions  through  intensive 
2-month  reviews.  On  March  2,  1981, 
he  chartered  five,  full-time  groups  to 
recommend  initiatives  for  improving 
the  PPBS  and  the  overall  acquisition 
process.  On  April  30,  three  months 
after  the  Reagan  Administration 
began,  Mr.  Carlucci  issued  a 
DEPSECDEF  memorandum,  "Im¬ 
proving  the  Acquisition  Process,"  to 
direct  32  AIP  actions.  For  more  infor¬ 
mation,  see  the  bummer  1982 
Concepts  special  issue  devoted  to  "The 
DOD  Acquisition  Improvement  Pro¬ 
gram"  a  year  after  its  initiation.14  This 
emergency  expediting  process  is  not, 
however,  an  apt  substitute  for  con¬ 
tinued  maintenance  of  truer  percep¬ 
tions  of  the  critical  DSAM  issues. 

Adjusted  Perceptions 

The  Administration's  overall  view 
toward  national  defense  issues  tends  to 
limit  drastic  change  when  a  key  ac¬ 
quisition  policy-maker  is  replaced. 
However,  the  successor  often,  in  effect, 
adjusts  perceptions  that  guide  the  Ad¬ 
ministration's  acquisition  improve¬ 
ment  initiatives.  Relying  on  personal 
perceptions  stemming  from  different 
acquisition  experiences  than  the 
predecessor,  a  new  policy-maker  often 
changes  previously  established  actions 
through  selective  emphasis,  or  by 
directing  other  initiatives  which  he  em¬ 
phasizes.  By  not  emphasizing  an  in¬ 
itiative  until  it  is  institutionalized,  the 
successor  can  let  earlier-directed  ac¬ 
tions  die  through  neglect. 

The  main  effect  of  turnovers  of  key 
policy-makers  during  an  Administra¬ 
tion  is  to  increase  the  frequency  of 
changes  in  perceptions,  thus  disrupting 
continuity  of  the  perceptions  which 
guide  long-term  improvements  in  the 
DSAM  process.  Discontinuities 
resulting  from  successive  differences  in 
personal  perceptions  are  illustrated  by 
the  five  who  have  served  as  the  chief 
defense  acquisition  policy-maker 
during  the  first  7  years  of  the  Reagan 
Administration— Deputy  Secretaries 
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of  Defense  Carlucci,  Thayer,  and  Taft; 
and  Under  Secretaries  of  Defense  for 
Acquisition  (USDA)  Goodwin  and 
Costello.  We  can  expect  more  ad¬ 
justments  in  policy-making  perceptions 
since  Mr.  Carlucci's  confirmation  as 
Secretary  of  Defence,  replacing  C-spar 
Weinberger.  I  will  summarize  ex¬ 
amples,  but  list  references  for  more 
information. 

Then  Deputy  Secretary  of  Defense 
Carlucci  directed  the  32  AIP  actions  in 
April  1981.  Four  months  after  re¬ 
placing  Mr.  Carlucci  in  January  1983, 
Mr.  Thayer  selected  12  of  the  original 
32  AIP  actions  and  consolidated  them 
into  6  for  his  personal  emphasis.15 
One  year  after  appointment, 
Mr.  Thayer  expanded  part  of  another 
AIP  Action  into  a  new  DOD 
Streamlining  Initiative.16  Thayer's  ad¬ 
justments  left  7  of  the  original  32  DOD 
initiatives  for  his  emphasis  in  DOD 
acquisition. 

Mr.  Taft  replaced  Mr  Thayer  in 
February  1984,  and  within  5  months 
instituted  a  new  Defense  Industrial 
Base  Initiative  to  begin  integrating  in¬ 
dustrial  base  considerations  into  the 
DSAM  process.  The  General  Accoun¬ 
ting  Office  (GAO)  listed  this  as  No.  33 
of  the  DOD  AIP  Initiatives17  but  from 
a  DOD  emphasis  standpoint  it  appears 
to  be  treated  more  as  an  eighth  in¬ 
itiative.  Mr.  Taft  continued  to 
strengthen  the  Streamlining  Initiative 
in  many  ways,  including  three  annual 
Defense  Acquisition  Streamlining  Con¬ 
ferences,  and  publication  of  a  new 
DOD  Directive  5000.43.  "Acquisition 
Streamlining,”  mandating  use  of  ac¬ 
quisition  streamlining  initiatives  on  all 
new  programs. 

Mr.  Goodwin,  appointed  to  the 
newly  created  position  of  Under 
Secretary  of  Defense  for  Acquisition 
(USDA)  on  September  30,  1986,  began 
to  implement  those  parts  of  three 
enactments  by  the  Congress  which 
supported  the  Commission’s  recom¬ 
mendations.18  He  began  by  stream¬ 
lining  and  simplifying  the  DOD  ac¬ 
quisition  system  through  defense 
reorganization,19  and  by  trying  to 
fulfill  out  his  responsibilities  as  the  new 
USDA  according  to  DOD  Directive 
5134.1.  Mr.  Goodwin  resigned  in 
September  1987  after  revised  DOD 
Directive  5000.1  was  issued  giving  the 


Defense  Resources  Board  (DRB) 
authority  to  revise  acquisition  program 
plans  without  prior  approval  of  the 
Defense  Acquisition  Board  (DAB) 
chaired  by  Goodwin.20  Later,  in 
testimony  before  the  House  Armed 
Services  Committee,  the  former  ac¬ 
quisition  Chief  proposed  legislation 
that  would  dramatically  increase  the 
authority  of  the  USDA.21 

Dr.  Robert  B.  Costello,  confirmed 
USDA  on  December  18,  is  initially  em¬ 
phasizing  changes  in  long-term  DOD 
stratep:es  for  mobilization  and  produc¬ 
tion.  He  has  proposed  a  multifaced 
strategy  for  enhancing  the  defense  in¬ 
dustrial  base.22  This  was  one  of  his 
main  concerns  as  Assistant  Secretary 
for  Acquisition  and  Logistics. 

Mr.  Carlucci,  confirmed  Secretary 
of  Defense  on  November  20,  1987,  is 
top  DOD  policy-maker.  Because  of  his 
earlier  active  roles  in  DOD  acquisition 
during  this  Administration,  we  should 
expect  to  see  more  examples  of  how 
turnover  of  a  key  policy-maker  adjusts 
the  perceptions  which  initiate  and 
guide  changes  in  the  DSAM  process. 

At  least  four  important  lessons  can 
be  learned  from  these  and  other  results 
of  the  first  two  changes  triggers: 

—Turnovers  in  top  policy-makers  are 
inherent  and  cannot  be  avoided 

—Turnovers  bring  different  percep¬ 
tions  of  what  are  the  most  crucial  ac¬ 
quisition  problems  and  issues,  and  of 
how  they  should  best  be  resolved 

—  These  discontinuities  in  perceptions 
of  "what"  and  "how"  often  trigger  new 
changes  in  the  DSAM  process  before 
earlier  changes  can  be  institutionaliz¬ 
ed,  and  so  impede  steady  improvement 
in  the  DSAM  process.  This  fact  em¬ 
phasizes  the  need  for  better  DSAM 
knowledge  and  information  aids  to 
track  new  initiatives  and  retain  lessons 
learned— insufficiencies  to  correct, 
mistakes  to  avoid  repeating,  and  suc¬ 
cessful  initiatives  to  continue 

—  Lack  of  a  DSAM-information  cor¬ 
porate  memory  prevents  maintenance, 
over  changes  in  policy-makers,  of  truer 
perceptions  of  the  most  critical  DSAM 
issues  and  problems,  and  of  how  best 
to  resolve  them. 


Public  Perceptions 

The  third  trigger,  public  perceptions 
of  mismanagement  in  defense 
acquisition— overpriced  spare  parts, 
cost  and  schedule  overruns,  and  test 
deficiencies — sparked  establishment  of 
the  President's  Blue  Ribbon  Commis¬ 
sion  on  Defense  Management  in  July 
1985. 23  President  Reagan  established 
the  Commission  with  Executive  Order 
12526,  assigning  it  a  scope  of  study 
that  included  both  acquisition  manage¬ 
ment  and  the  larger  environment 
within  which  DSAM  processes 
operate.24 

The  President  chose  Commission 
members  with  widely  respected  ex¬ 
perience  in  government,  industry, 
business  and  academia;  including  ex¬ 
perience  in  the  U.S.  Senate, 
general/flag  officer  experience  in  the 
Pentagon,  and  national  security  affairs 
experience  in  the  White  House. 

Three  members,  having  served  in 
key  OSD  and  industry  positions  in 
defense  systems  acquisition,  brought 
extensive  DSAM  knowledge  and 
perceptions.  Chairman  David  Packard 
and  Frank  C.  Carlucci  had  been  Depu¬ 
ty  Secretaries  of  Defense;  Dr.  William 
J.  Perry  was  n  Under  Secretary  of 
Defense  for  Research  and  Engineering. 
Each  was  the  top  defense  acquisition 
policy-maker  when  in  DOD.  Each 
knew,  from  personal  experience, 
specific  improvements  needed  in  the 
DSAM  process  and  organization  in¬ 
cluding  the  great  need  for  better  long- 
range  planning  and  better  DSARC- 
PPBS  integration.  They  and  other 
members  brought  perceptions  from 
widespread  experiences  showing 
alarming  deterioration  in  the  defense 
management  culture,  and  the  need  for 
major  changes  in  the  environment  of 
defense  acquisition  management. 

The  Commission's,  A  Quest  for  Ex¬ 
cellence:  Final  Report  to  the  President 
(see  Endnote  1),  with  its  interim  reports 
and  appendix  is,  perhaps,  the  most 
comprehensive  report  ever  made  on 
the  whole  defense  acquisition  manage¬ 
ment  process  including  its  environ¬ 
ment.  One  chapter,  "Acquisition 
Organization  and  Procedures,"  has 
recommendations  for  the  acquisition 
system,  a.k.a.  DSAM  process.  Equal¬ 
ly  important,  other  chapters, 
"National  Security  Planning  and 
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Budgeting,"  "Government-Industry 
Accountability,"  and  "Military 
Organization  and  Command,”  recom¬ 
mend  changes  in  three  different  aspects 
of  the  acquisition  environment  within 
which  DSAM  processes  operate,  and 
witn  which  they  interact. 


Following  are  short  commentaries 
on  all  except  the  cnapter  on  "Military 
Organization  and  Command."  Crea¬ 
tion  of  the  new  position,  Vice  Chair¬ 
man  of  the  Joint  Chiefs  of  Staff,  which 
enables  direct  military  user  represen¬ 
tation  in  system  acquisition  decision¬ 
making,  is  treated  later  as  "Organiza¬ 
tional  Structure." 


Acquisition 

Organization  and  Procedures 


The  Commission  concluded  that  the 
defense  acquisition  (DSAM  process) 
has  basic  problems  that  must  be  cor¬ 
rected.  They  recommended  many 
changes  to  correct  these  problems, 
grouping  them  under  9  headings.25 
The  9  sets  of  recommendations  encom¬ 
pass  many  of  the  32  DOD  AIP  actions 
hurriedly  assembled  in  1981,  but  also 
some  changes  not  in  the  AIP.  Unfor¬ 
tunately,  no  information  linking  the  32 
AlP  actions  directed  by  then  Deputy 
Secretary  Caiiucci  in  19C1  appears 
available  to  provide  background, 
problems  encountered,  status,  lessons 
learned,  and  other  information  that 
would  be  useful  in  judging  AIP  pro¬ 
gress  since  1981,  and  in  implementing 
the  9  sets  of  changes  recommended  in 
1986.  The  Commission  concluded  that 
meaningful  improvement  from  these 
recommended  changes  will  come  only 
with  major  institutional  change  in  the 
defense  management  environment  and 
culture  within  which  the  changed  pro¬ 
cesses  would  operate. 


National  Security 
Planning  and  Budgeting 

Considering  the  national  planning 
and  resource  allocation  environment, 
the  Commission  focused  first  on  an 
aspect  which  has  always  been  the  chief 
source  of  program  instability  in 
defense  acquisition.  It  perceived  the 
necessity  to  improve  national  security 
planning  to  establish  the  nation's 
security  objectives — diplomatic, 
domestic,  and  military.  Focusing  on 
defense  acquisition  processes,  they 
perceived  the  need  to  bring  together 
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the  military  security  objectives,  the 
forces  needed  to  achieve  them,  and  the 
resources  available  to  support  these 
forces;  and  to  clearly  establish  this 
relationship  using  a  national  military 
strategy.  Furthermore,  they  perceived 
the  accompanying  need  for  im¬ 
provements  in  the  PPBS  itself,  par¬ 
ticularly  in  long-range  planning  and 
programming.  These  improvements  in 
the  PPBS  are  needed  to  track  resources 
expected  to  be  available  to  acquire 
"right"  defense  systems — those  which 
can  best  achieve  the  national  military 
strategy  within  available  resources. 
They  are  needed  to  achieve  stability  in 
defense  acquisition  programs  through 
more  stable  congressional  budgeting, 
authorizations  and  appropriations.26 


i  xcellence  in 
defense  management 
will  not  be  achieved 
through  legions  of 
government  auditors, 
inspectors  and  in¬ 
vestigators.  It  depends 
on  the  honest  part¬ 
nership  of  thousands 
of  responsible  contrac¬ 
tors  and  DOD....” 


Government-Industry 
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current  ways  of  doing  business  in  favor 
of  a  renewed  quest  for  excellence."  It 
ends,  "Excellence  in  defense  manage¬ 
ment  will  not  be  achieved  through 
legions  of  government  auditors,  in¬ 
spectors  and  investigators.  It  depends 
on  the  honest  partnership  of  thousands 
of  responsible  contractors  and  DOD, 
each  committed  to  proper  control  of  its 
own  operations."28  By  implication  in 
other  parts  of  their  report,  the  Com¬ 
mission  included  the  Congress  in  this 
honest  partnership,  committed  to  pro¬ 
per  control  of  its  budgeting,  authoriza¬ 
tion,  appropriations  and  oversight 
operations  in  support  of  a  more  pro¬ 
ductive  defense  acquisition  process. 


The  report  calls  for  a  new  spirit  of 
cooperation  among  the  Executive 
Branch,  the  Congress  and  Industry.  It 
recommends  starting  with  more  effec¬ 
tive  contractor  self-governance,  in¬ 
cluding  implementing  defense  industry 
initiatives  on  buisness  ethics  and  con¬ 
duct.  It  recommends  that  DOD  and 
the  Congress  foster  effective  contrac¬ 
tor  self-governance  through  more  con¬ 
structive  defense  acquisition  over¬ 
sight.29 


The  Commission's  recommenda¬ 
tions  sparked  what  could  be  the 
greatest  (and  most  controversial) 
changes  in  acquisition  management 
since  the  Defense  Department  was 
established  40  years  ago.30  However, 
progress  since  June  publication  of  its 
final  report,  and  October  1986  comple¬ 
tion  of  legislation  supporting  many  of 
its  recommendations,  has  been  slow. 


One  year  after  the  final  report. 
Chairman  Packard  noted  in  a  letter  to 
President  Reagan  that  an  excellent  start 
had  been  made.  Much  has  been  ac¬ 
complished  organizationally  as  DOD 
and  the  Congress  worked  with  com¬ 
mon  purpose.  But  he  was  critical  about 
other  areas,  noting  that; 


Considering  the  broader  govern¬ 
ment-industry  environment  and 
defense  management  culture,  the  Com¬ 
mission  perceived  that  "nothing  merits 
greater  concern  than  the  increasingly 
troubled  relationship  between  the 
defense  industry  and  government."27 
The  Foreword  of  the  final  report  states 
"...ways  must  be  found  to  restore  a 
sense  of  shared  purpose  and  mutual 
confidence  among  Congress,  DOD, 
and  industry.  Each  must  forsake  its 


—  Funding  stability,  needed  to  obtain 
more  defense  per  dollar  through  pro¬ 
grams  that  are  stable,  sustained,  and 
predictable  over  several  years,  has  not 
been  achieved  due  to  opposition  in  the 
Congress.  More  defense  can  be  pro¬ 
vided  per  dollar  if  programs  are  stable, 
sustained,  and  predictable  over  several 
years.  Packard  states  "That  stability 
has  not  been  achieved.... Opposition  in 
the  Congress  to  adequate  and  stable 
levels  of  funding  for  defense... is  begin- 
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ning  to  pose  serious  problems  for  our 
long-term  national  security. " 

—  Personnel  policy  is  the  keystone  of 
virtually  all  reforms  proposed  by  the 
Commission,  but  efforts  last  year 
tailed  to  obtain  government-wide 
reform  of  the  Civil  Service  system, 
which  does  not  allow  for  contracting 
officer  educational  criteria.  The  Com¬ 
mission  urges  specific  legislation  to  en¬ 
sure  senior  DOD  civilian  acquisition 
personnel  can  be  promoted,  paid  and 
educated  adequately. 

—  The  L'SDA  has  not  been  given  ade¬ 
quate  authority,  due  partly  to  present 
legislation  and  partly  to  DOD  policy 
implementation. 

—  Several  problems  remain  in 
government-industry  relations.31 

Important  lessons  can  be  drawn 
from  the  Commission's  Final  Report 
and  from  Chairman  Packard's  follow¬ 
up  letter. 

The  report  identified  basic  deficien¬ 
cies  in  the  acquiUHon  system  processes 
and  organizational  structure. 

The  report  identified  major  deficien¬ 
cies  in  the  environment  and  culture  of 
acquisition  management  which  must 
be  remedied  to  realize  meaningful  im¬ 
provement  from  the  Commission's 
recommended  changes  in  the  acquisi¬ 
tion  system.  Deficiencies  are  in  the  na¬ 
tional  security  planning  and  budgeting 
environment,  which  induces  instabi¬ 
lity  into  system  acquisition  programs, 
perhaps  doubling  acquisition  times  and 
significantly  increasing  system  costs; 
also,  government-industry  environ¬ 
ment,  which  is  almost  devoid  of  a 
sense  of  shared  purpose  and  mutual 
confidence  among  the  Congress,  DOD 
and  industry;  Military  organization 
and  command  environment,  where  the 
real  users  (Commanders-in-Chiefs  of 
Unified  and  Specified  Commands)  are 
not  adequately  represented  in  weapons 
requirements  decision-making,  and 
resource-constrained,  long-range 
defense  planning  is  not  supported, 

The  Administration,  the  Congress 
and  the  Defense  Industry  must  do 
much  more  to  generate  a  hospitable  ac¬ 
quisition  environment  and  promote  a 
new  defense  management  culture  so 
that  needed  changes  in  the  DSAM  pro¬ 
cess  increase  productivity  substan¬ 
tially  in  defense  acquisitions. 
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The  Commission  was  concerned 
about  two  findings:  the  increasingly 
troubled  relationship  between  the 
defense  industry  and  government,  and 
the  depth  of  public  mistrust  of  defense 
contracting.  The  Commission  is 
dismayed  by  the  lack  of  effective  ac¬ 
tion  to  remedy  these  conditions.  I 
believe  the  Commission  recognizes 
that  restoring  a  sense  of  the  Congress- 
DOD-lndustry  shared  purpose  and 
mutual  confidence  is  a  prerequisite  to: 

—  Gaining  better  congressional  sup¬ 
port  for  longer-term  planning  and 
budgeting  procedures  needed  to  im¬ 
prove  program  stability  and,  thus, 
substantially  shorten  schedules  and 
reduce  costs  of  acquisition  program: 

— Cleansing  current  adversarial  at¬ 
mosphere  harming  out  industrial  base 
and,  thus,  assure  our  future  capabi¬ 
lity  to  acquire  systems  needed  for  ade¬ 
quate  defense 

—  Restoring  public  confidence  in  our 
defense  acquisition  system  and,  thus, 
public  support  for  adequate  national 
defense. 

We  as  a  nation  can  ignore  these 
lessons,  and  accept  present  DSAM 
process  deficiencies  and  corrective  ac¬ 
tion  inadequacies,  only  at  our  future 
peril.  Or,  we  can  use  them  to  motivate 
and  achieve  greater  DOD-Congress- 
Industry  cooperation  to  increase  pro¬ 
ductivity  substantially  in  defense  ac¬ 
quisition,  and,  thus,  provide  adequate 
economic  national  defense  in  a  budget 
deficit  environment. 

Underlying  Problems 

These  three  frequent  triggers  of 
change  in  the  acquisition  process  have 
sparked  spasmodic,  trial-and-error 
but,  overall,  evolutionary  develop¬ 
ment  of  management  improvements  in 
DSAM  processes.  Some  changes  to  in¬ 
crease  process  integration  (e.g.,  initia¬ 
tion  of  PPBS  development  and  institu¬ 
tion  of  the  DSARC)  have  proved  to  be 
outstanding  management  im¬ 
provements  and  bases  for  continuing 
evolutionary  improvements.  Other 
changes,  like  development  of  Total 
Package  Procurement,  have  required 
time-consuming  and  dollar-wasting 
corrections  in  the  whole  DSAM  pro¬ 
cess.  A  long-term  evaluation  indicates 
enormous  overall  improvement  in  the 
process,  but  a  review  of  results  shows 


many  crucial  issues  are  unresolved  by 
current  processes.  Research  results  in¬ 
dicate  most  improvements  in  DSAM 
processes  were  necessary,  some 
outstanding,  but  many  wer»  "Qt  suffi¬ 
cient.  They  did  no.  keep  pace  with  the 
need  for  more  productive  management 
of  increasingly  complex  programs  in  a 
dynamic  environment,  and  did  not 
reduce  acquisition  times  or  costs 
dramatically  to  increase  acquisition 
productivity  substantially  to  assure 
adequate  defense  in  a  budget-deficit 
environment. 

The  Department  of  Defense  was 
established  40  years  ago  to  integrate 
U.S.  defense  operations  and  improve 
defense  acquisition  processes  to  sup¬ 
port  those  operations.  It  took  40  years 
to  improve  DSAM  processes  to  their 
present  state,  which  now  seems  so 
logical  and  necessary  for  management 
of  complex  defense  system  acquisi¬ 
tions.  Yet,  this  progress  was  not  suffi¬ 
cient  to  increase  productivity  substan¬ 
tially.  These  facts  raise  two  important 
questions  whose  answers  can  pro¬ 
foundly  affect  our  future:  Why  did  it 
take  so  long  to  improve  DSAM  pro¬ 
cesses  to  their  present  level  of  integra¬ 
tion  and  productivity?  How  can 
DSAM  process  improvement  be  ac¬ 
celerated  to  increase  defense  acquisi¬ 
tion  productivity  substantially? 

The  above  discussion  indicates  that 
a  partial  answer  to  the  first  question 
is  turnovers— seven  turnovers  of  Ad¬ 
ministrations  with  five  rotations  of 
political  parties  since  the  Department 
of  Defense  was  established;  also,  turn¬ 
overs  of  key  acquisition  policy-makers 
during  Administrations. 

Another  partial  answer  is  turnovers 
in  members  of  congressional  commit¬ 
tees  having  significant  influence  on 
aspects  of  defense  acquisition  legisla¬ 
tion.  The  adverse  effect  of  these  turn¬ 
overs  on  defense  acquisition  is  exacer¬ 
bated  by  the  propensity  of  the  Con¬ 
gress  toward  line-item  management  of 
annual  budgets,  which  is  reenforced  by 
pressures  for  individual  members  to 
curry  favor  with  their  constituents 
when  dealing  with  defense  issues.  The 
lesson  here  is  that  all  three- 
congressional  turnovers,  the  congres¬ 
sional  propensity,  and  attendant  con¬ 
stituent  pressures— combined  to  stifle 
motivation  of  members  of  the  Con- 
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gress  to  develop  shared  truer  percep¬ 
tions  with  the  Administration  of 
critical  national  defense  and  defense 
system  acquisition  issues. 

The  second  and  more  crucial  ques¬ 
tion  is:  "How  can  DSAM  process  pro¬ 
ductivity  be  increased?"  Before 
answering,  we  must  identify  past  insuf¬ 
ficiencies  and,  equally  important,  their 
causes. 

1  have  observed  the  effects  on 
defense  systems  acquisition  of  six 
changes  of  Administration,  from 
Eisenhower  to  Reagan.  Four  were 
changes  of  political  parties.  In  each  of 
the  four,  I  saw  major  shifts  of  direc¬ 
tion  and  emphasis  in  the  management 
of  defense  system  acquisitions,  as  well 
as  visible  shifts  after  most  changes  of 
key  defense  acquisition  policy-makers. 
YVhv  the  shifts? 


tent  steady  improvement  and  integra¬ 
tion  of  complex  DSAM  processes;  and 

—  How  to  sustain  truer-perception- 
guided  actions  directed  m  acquisition 
improvement  programs  long  enough 
to  institutionalize  them. 

The  most  recent  result  of  the  third 
trigger,  public  perceptions  of  acquisi¬ 
tion  mismanagement,  is  the  198o 
report  of  President's  Commission. 
Findings  reveal  an  equally  important 
fourth  problem;  How  to  foster  shared 
truer  perceptions  among  Administra¬ 
tion  policy-makers  and  members  of  the 
Congress. 


Are  real  acquisition  management 
needs,  or  are  new  perceptions  of  new 
policy-makers,  the  primary  deter¬ 
minants  of  directions  and  emphasis  of 
new  DSAM  process  developments  that 
are  crucial  to  our  country's  defense? 
How  can  we  develop  truer  perceptions 
of  emerging  real  acquisition  manage¬ 
ment  needs,  and  document  them  in 
long-range  plans  as  drivers  for  con¬ 
tinual  improvements  which  increase 
productivity  substantially  in  DSAM 
processes? 

Turnovers  of  Administrations,  key 
policy-makers,  and  the  Congress, 
bring  discontinuities  in  the  perceptions 
that  drive  DSAM  process  im¬ 
provements,  disrupting  endeavors  to 
steadily  improve  and  integrate  DSAM 
processes.  These  disruptions  stem  from 
four  interrelated  problems. 

Analysis  of  results  of  the  first  and  se¬ 
cond  triggers  reveal  a  set  of  three  pro¬ 
blems.  These  inherent  problems  must 
be  coped  with  continually  to  counter 
adverse  effects  of  turnovers  of  Ad¬ 
ministrations,  and  during  Administra¬ 
tions;  also,  to  dampen  large  swings  in 
perceptions  guiding  efforts  to  improve 
the  overall  DSAM  process.  The  prob¬ 
lems  are; 

—  How  to  develop  truer  perceptions  to 
guide  specific  improvements  in  DSAM 
processes; 

—  How  to  maintain  the  truer  percep¬ 
tions  over  turnovers  to  guide  consis- 
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I  acquisition  manage¬ 
ment  needs,  or 
|  new  perceptions  of 
new  policy-makers, 
the  primary  deter¬ 
minants  of  directions 
and  emphasis  of 
new  DSAM  process 
developments  that 
are  crucial  to  our 
country’s  defense? 

Packard  Commission  Report 

Not  Sufficient 

Having  considered  management- 
change  triggers  stemming  from 
changed  perceptions,  policy-maker 
and  public,  we  are  ready  to  consider 
insufficiencies  in  organizational  pro¬ 
cesses  having  limited  increases  in  ac¬ 
quisition  productivity. 

Failure  to  fully  recognize  and  the  in¬ 
ability  to  deal  with  these  four  inter¬ 
related  problems  was  the  most  crucial 
insufficiency  of  all  past  endeavors  to 
improve  and  integrate  DSAM  pro¬ 
cesses  enough  to  increase  acquisition 
productivity  substantially. 
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The  third  trigger  indicates  a  second 
insufficiency.  Why  did  it  take  public 
perceptions  of  acquisition  mismanage¬ 
ment  to  prompt  the  President  to  ap¬ 
point  a  Blue  Ribbon  Commission  to 
study  accumulated  long-standing  ac¬ 
quisition  problems?  Many  of  their 
recommendations  are  recognized  as 
lor.g-needed  changes  in  defense  ac¬ 
quisition  processes  and  organizational 
structures.  Why  w:.e  the  changes  not 
started  earlier?  The  answer:  failure  or 
inability  to  identify  emerging  real 
management  problems  for  timely 
policy-decisions  and  corrective 
actions. 

The  root  of  this  crucial  insufficien¬ 
cy  was  failure  to  periodically  review 
the  complex  DSAM  process  as  com¬ 
prehensively  as  the  President's  ad  hoc 
commission  did,  but  with  an  impor¬ 
tantly  different  objective:  To  assure 
continual  management  improvement 
to  cope  with  real  problems  as  they 
emerge  in  the  dynamic  environment  of 
acquisition,  before  they  do  costly 
damage  and  cannot  be  ignored.  The 
failure  results  from  a  misapplication  of 
the  practical  management  philosophy, 
"If  it  ain't  broke,  don't  fix  it,”  by 
prefixing  it  with  a  complacent  ostrich- 
like  twist,  "If  you  don't  see  it's  broke, 
it  ain't."  The  current  troubled  relation¬ 
ship  between  government  and  defense 
industry,  and  the  loss  of  support  for 
adequate  national  defense  by  a  disillu¬ 
sioned  public  are  two  perilous  conse¬ 
quences  of  this  failure. 

Regular  comprehensive  reviews  of 
the  oveall  DSAM  process  to  resolve 
this  second  insufficiency  will  not, 
however,  be  sufficient.  Timely  inden- 
tification  of  emerging  real  acquisition 
management  issues  and  problems  is 
essential,  but  more  is  needed— ability 
to  do  something  about  all  identified 
problems.  If  we  consider  the  1985-86 
comprehensive  review  by  the  Presi¬ 
dent's  Commission  as  the  first  of  con¬ 
tinuing  regular  top-level  reviews  of  the 
whole  defense  acquisition  process  and 
its  environment,  this  will  help  identify 
other  major  insufficiencies  in  past  ef¬ 
forts  to  improve  the  overall  DSAM 
process. 

The  Commission  took  a  year  to 
review  the  defense  acquisition  system 
(DSAM  process)  and  its  environment. 
Its  report  shows  a  way  to  achieve 

May- 1  unc  1988 


( 


substantial  increases  in  productivity  if 
we  are  willing  to  use  new  innovations 
in  industrial  management  and  apply 
promising  new  concepts  and 
technology  instead  of  clinging  to  in¬ 
adequate  management  practices.  The 
Commission  said  in  the  Report's 
Foreword  that  it  intended  recommen¬ 
dations  to  help  establish  strong  and 
sound  policies  rigidly  adhered  to 
throughout  the  DOD.  It  emphasized 
that  execution  of  these  policies  should 
be  decentralized;  that  decentralized  ex¬ 
ecution  in  the  large  complex  enterprise 
of  national  defense  requires  cultivation 
of  "resilient  centers  of  management  ex¬ 
cellence  dedicated  to  advancing  DOD's 
overall  goals  and  objectives." 


Other  Commission  statements  in  the 
Foreword  concerning  the  requirement 
for  "centers  of  management  ex¬ 
cellence/'  provide  evidence  that  past 
progress  in  improving  acquisition 
management  has  not  been  sufficient  in 
two  critical  aspects  of  the  DSAM 
process. 


First,  the  Commission  states,  "Ex¬ 
cellence  in  defense  management... re¬ 
quires. .  .responsibility  and  authority 
placed  firmly  in  the  hands  of  those  at 
the  working  level,  who  have 
knowledge  and  enthusiasm  for  the 
tasks  at  hand."  This  means  that  besides 
responsibility  and  authority,  excellence 
requires  knowledge  and  enthusiasm; 
but.  enthusiasm  without  knowledge  is 
disastrous.  So  a  first  requirement  for 
excellence  in  decentralized  implemen¬ 
tation  of  acquisition  management  is 
that  every  working-level  professional 
(from  top  policy-maker  to  lowest  pro¬ 
gram  implementer)  given  responsibility 
and  authority  for  a  job,  must  possess 
all  relevant  DSAM  knowledge  and 
have  all  DSAM  information  needed 
for  tasks  at  hand.  There  is  wide 
variance  in  the  degree  that  relevant 
knowledge  and  information  require¬ 
ment  is  met  in  the  real  world,  but 
usually  less  than  100  percent. 
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sufficiency  is  crucial  whenever 
management  is  decentralized  as  envi¬ 
sioned  by  the  Commission.  It  must  be 
resolved  before  the  proposed  "centers 
of  management  excellence"  can  func¬ 
tion  effectively  in  "advancing  DOD's 
overall  goals  and  objectives." 


This  requirement  for  every  DSAM 
professional  to  have  the  relevant 
DSAM  knowledge  and  information  for 
his- her  job  and  tasks  highlights  the 
third  insufficiency  of  past  acquisition 
improvement  efforts— lack  of  aids  to 
provide  supplementary  DSAM  know¬ 
ledge  and  relevant  DSAM  information 
when  needed  in  a  job  or  task.  This  in- 


(e.g.,  PPBS  and  DAB  processes)  and 
its  many  functional  subprocesses  (e.g., 
planning,  budgeting,  contracting, 
developing,  testing,  producing, 
training,  modernizing). 


Second,  the  Commission  concludes, 
"To  accomplish  this  (excellence  in 
defense  management),  ways  must  be 
found  to  restore  a  sense  of  shared  pur¬ 
pose  and  mutual  confidence  among 
Congress,  DOD,  and  industry."  Past 
efforts  to  improve  acquisition  manage¬ 
ment  have  not  been  sufficient  to  induce 
such  changes  in  the  culture  of  defense 
management.  If  anything,  some  past 
improvement  actions  have  reduced  the 
sense  of  shared  purpose  and  mutual 
trust;  e.g.,  new  audit  policies,  and 
several  unintegrated  functional  policies 
whose  combined  effect  has  been  to  in¬ 
crease  contractor  risks  while  reducing 
their  ability  to  deal  with  the  risks. 

Furthermore,  the  Commission 
recommends  major  constructive 
changes  in  the  present  environment  of 
defense  acquisition:  national  security 
planning  and  budgeting,  in 
government-industry  contracting,  and 
military  organization  and  command. 
This  is  more  evidence  that  past  pro¬ 
gress  was  not  sufficient;  it  had  not 
achieved  such  constructive  changes  in 
the  larger  environment  within  which 
DSAM  processes  operate. 

These  Commission  conclusions  and 
recommendations  highlight  the  fourth 
major  insufficiency  of  past  improve¬ 
ment  efforts— inability  to  continually 
induce  essential  changes  in  the  defense 
management  culture,  and  to  "manage” 
constructive  change  in  the  larger  en¬ 
vironment,  within  which  DSAM  pro¬ 
cesses  operate  and  with  which  they  in¬ 
teract,  to  enable  substantial  increases 
in  acquisition  management  productiv¬ 
ity. 

Organizational  Structures 

The  third  productivity  element  is  ef¬ 
ficient  organizational  structures.  The 
purpose  of  any  organizational  struc¬ 
ture  is  to  support  organizational  pro¬ 
cesses.  The  large,  complex  and  highly 
interactive  DSAM  process  encom¬ 
passes  many  organizations  and 
transcends  many  organizational  boun¬ 
daries.  So  do  its  major  subprocesses 
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Each  organization's  structure  should 
support  its  own  internal  processes  and 
larger  DSAM  processes  in  which  the 
organization  interacts,  and  in  a  way 
that  assures  greatest  overall  acquisition 
productivity.  Ideally,  an  organization's 
structure  should  not  be  changed 
without  considering  all  acquisition 
processes  that  will  be  affected. 


The  complexity  and  "interac¬ 
tiveness"  of  DSAM  processes  make  it 
difficult,  if  not  impossible,  for  in¬ 
dividuals  to  identify  beforehand  all 
processes  that  will  be  seriously  affected 
by  a  change  in  organizational  struc¬ 
ture.  So  most  changes  in  organization 
are  based  upon  consensus  of  ad  hoc 
groups.  Strengths  and  weaknesses  of 
ad  hoc  group  consensus  can  be  seen  in 
the  reorganization  recommendations 
of  the  President's  Commission. 


The  Commission  recommended  and 
the  Congress  created  two  new  DOD 
positions:  Under  Secretary  of  Defense 
(Acquistion)  in  OSD,32  and  Vice 
Chairman  of  the  Joint  Chiefs  of 
Staff.33  Both  recommendations  and 
the  follow-on  congressional  enact¬ 
ments  are  seen  as  significant  im¬ 
provements  in  defense  acquisiton 
management. 


On  February  10,  1987,  DOD  Direc¬ 
tive  5134.1  made  the  new  Under 
Secretary  of  Defense  (Acquisiton)  the 
full-time  Defense  Acquisition  Ex¬ 
ecutive  (DAE)  with  responsibility  for 
supervising  the  entire  DOD  acquisition 
system.  This  reorganization  con¬ 
solidates  most  OSD  acquisition  staff 
responsibilities  under  the  USDA; 
makes  him/her  the  DOD  Procurement 
Executive;  vests  in  him/her  authority 
for  both  acquisition  policy-making  and 
decision-making;  and  makes  him/her 
a  powerful  Chairman  of  the  Defense 
Acquisition  Board  (DAB). 


The  role  the  new  Vice  Chairman  of 
the  JCS  can  now  play  in  decision¬ 
making  on  all  major  service  and  joint 
acquisition  programs  should  greatly 
improve  management  of  defense  ac¬ 
quisitions.  As  Vice  Chairman  of  the 
DAB,  which  can  make  early  trade-offs 


Mav-Junc  19X8 


a 


c 


between  system  cost  and  performance, 
he  provides  for  direct  top-level  DAB 
consideration  of  the  complementary 
and  competing  requirements  generated 
by  the  real  defense  system  users — the 
unified  and  specified  combatant  com¬ 
mands.34  (Also  see  Enanote  13.) 

These  changes  mainly  affect  the 
organization  of  DOD  acquisition  at 
OSD  and  JCS  levels,  above  the 
military  departments.  As  shown 
earlier,  these  are  DOD  organizational 
areas  in  which  the  Commission  had 
great  breadth,  and  depth  of  personal  ex¬ 
periences.  However,  the  Commission 
recommended  extending  DAE  direct 
supervision  of  acquisition  programs 
down  into  each  military  department  to 
program  managers.35 

This  last  reorganization  recommen¬ 
dation  has  raised  questions.  We  are  not 
concerned  here  with  questions  concer¬ 
ning  the  merits  of  this  recommenda¬ 
tion,  but  rather  with  questions  about 
the  sufficiency  of  ad  hoc  group  consen¬ 
sus  as  the  main  basis  for  recommenda- 
tions  concerning  very  complex 
organizational  structures.  Can  any  ad 
hoc  group  consider  every  acquisition 
process  that  will  be  affected  by  changes 
that  the  group  recommends  in 
organization  structure,  and  foresee  all 
critical  effects  of  the  changes  on  the 
processes?  Can  any  ad  hoc  group,  even 
the  President's  Commission,  have  suf¬ 
ficient  collective  experience  to  deter¬ 
mine,  for  very  complex  organizations 
with  complex  interactive  processes,  the 
best  reorganization  structure  (e.g.,  that 
structure  which  supports  the  whole 
DSAM  process  in  a  way  that  assures 
greatest  overall  acquisition  productivi¬ 
ty'  for  overall  structure? 

As  far  as  1  can  determine,  however, 
no  Commission  member  had  high- 
level  experience  in  oversight,  support 
or  execution  of  acquisition  programs 
in  a  military  department. General 
Robert  T.  Marsh,  USAF  (Ret.),  former 
Commander  of  the  Air  Force  Systems 
Command,  has  extensive  experience  in 
these  positions  in  a  military  depart¬ 
ment.  Based  on  his  experience,  he 
challenged  the  Commission's  recom¬ 
mendation  to  restructure  the  military 
departments  by  creating  System  Ac¬ 
quisition  Executives  responsible  for  all 
acquisition  programs.  He  showed  how 
the  recommended  restructuring  would 
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interface  with  numerous  oversight  and 
supporting  functions  provided  by  the 
acquisition  commands,  and  suggested 
alternatives  to  reorganization  for 
achieving  the  Commission's  objectives 
of  better  acquisition  program 
control.30 

Insights  from  the  Indian  fable  about 
six  blind  men  touching  an  elephant  and 
their  different  perceptions  apply  here. 
The  different  experiences  of  the  Com¬ 
mission  members  (at  military  depart¬ 
ment  levels  in  program  execution,  sup¬ 
port  and  oversight)  produced  different 
perceptions  of  the  problem,  and  how 
best  to  solve  it.  When  the  blind  men 
recognized  their  perceptions  problem, 
they  reasoned:  "Each  of  us  knows  only 
a  part.  To  find  the  whole  truth,  we 
must  put  all  of  the  parts  together." 

Assuring  that  ad  hoc  commis¬ 
sions/working  groups  are  large  enough 
to  represent  every  kind  of  relevant  ex¬ 
perience  would  be  impractical,  if  not 
impossible.  We  need  a  better  way  to 
"put  all  of  the  parts  together": 

—To  meld  results  of  wider  relevant 
defense  acquisition  experience,  so  that 
all  acquisition  processes  seriously  af¬ 
fected  will  be  considered  in  major 
organizational  restructuring  recom¬ 
mendations 

-  To  avoid  suboptimized  solutions 
based  mainly  upon  a  particular  level 
of  perceptions  (e.g.,  OSD,  military 
department,  congressional) 

— To  asure  better  availability  of  timely 
relevant  current  DSAM  information 
which  can  help  groups  develop  organi¬ 
zational-structure  solutions  that  max¬ 
imize  productivity  of  the  whole  DSAM 
process. 

"Putting  all  of  the  parts  together"  re¬ 
quires  information  from  many  sources 
concerning  process  operations  over 
time.  It  requires  integration  of  infor¬ 
mation  over  time  concerning  all 
elements  of  the  productivity  frame¬ 
work — objectives  and  strategies,  pro¬ 
cesses,  structure,  knowledge  and  infor¬ 
mation  resources,  and  the  overall  en¬ 
vironment  in  which  the  restructured 
organizations  will  function. 

Not  Sufficient 

Although  employing  an  ad  hoc 
group  is  the  best  known  to  find  solu¬ 


tions  to  complex  organizational  struc¬ 
ture  problems,  past  ad  hoc  groups 
have  had  three  serious  insufficiencies 
with  perennial  problems. 

The  first  stems  from  the  "for  this 
case  only"  nature  of  ad  hoc  groups— 
usually  formed  after  a  crisis  to  deal 
with  some  management  problem  that 
has  grown  so  large  it  can  no  longer  be 
ignored.  The  group  provides  its  find¬ 
ings  and  recommendations  for  a  one¬ 
time  solution  of  its  assigned  problem, 
usually  with  no  formal  provisions  for 
follow-up  to  make  adjustments  and 
assure  steady  progress  on  recom¬ 
mended  improvements. 

This  is  not  sufficient  for  complex 
perennial  problems  like  those  ad¬ 
dressed  by  the  President's  Commis¬ 
sion.  Ad  hoc  group  reports  seldom  in¬ 
clude  information  relating  to  earlier  ad 
hoc  reports  on  the  same  problem;  or 
any  between-report  information  on  the 
problems  encountered  implementing 
earlier  recommendations  or  documen¬ 
ting  specific  progress,  which  would  be 
useful  in  making  adjustments  and 
assuring  steady  progress  on  the  pro¬ 
blem.  For  example,  I  found  no  infor¬ 
mation  in  the  1986  report  about  the  32 
actions  directed  in  the  1981  DOD  Ac¬ 
quisition  Improvement  Program,  or  on 
implementation  problems  encountered 
and  progress  made  on  each  action. 

The  second  insufficiency  is  that  ad 
hoc  groups  addressing  complex  pro¬ 
blems  are  seldom  large  enough  to  in¬ 
clude  every  kind  of  relevant  DSAM  ex¬ 
perience  needed  to  address  compe¬ 
tently  all  aspects  of  their  assigned  pro¬ 
blems.  No  group  can  foresee  all  crucial 
effects  of  the  organizational  structure 
changes  they  recommend,  on  all  ac¬ 
quisition  processes  that  will  be  affected 
by  the  changes.  Each  group  needs  rele¬ 
vant  supplemental  DSAM  knowledge 
to  fill  voids  in  its  experiential 
knowledge. 

The  third  is  the  nature  of  informa¬ 
tion  available— hastily  assembled,  in¬ 
complete,  irrelevant,  a  snap-shot  at  a 
point  in  time,  not  well  tailored  to  the 
problem;  also,  lacking  are  DSAM  in¬ 
formation  aids  to  remedy  this  insuf- 
ficency.  Needed  aids  should  integrate, 
over  time,  information  from  all 
elements  of  the  productivity 
framework— objectives,  processes, 

Mav-June  1988 


K?. 

f 


structure,  DSAM  knowledge  and  in¬ 
formation  resources,  and  the  overall 
environment  in  which  the  restructured 
organizations  will  function.  Such 
DSAM  knowledge  and  information 
aids  could  serve  as  institutional 
memory  aids  to  augment  the  ex¬ 
perience  of  groups  like  the  President's 
Commission.  These  aids  could  provide 
timely  and  relevant,  current  and 
historical  DSAM  knowledge  and  infor¬ 
mation  to  assist  regularly  appointed, 
qualified  top-level  groups  in  periodic 
overall  reviews  of  the  DSAM  process. 

To  overcome  the  present  ad  hoc 
group  insufficiencies  and  collect  rele¬ 
vant  DSAM  knowledge  and  informa¬ 
tion  for  these  aids  (much  not  available 
elsewhere)  we  need  thorough,  regular¬ 
ly  scheduled,  periodic,  Presidential 
Commission  type  reviews: 

— Of  the  whole  DSAM  process  for  ac¬ 
quiring  defense  system 

—Of  the  acquisition  environment- 
political,  economic,  ethical— in  which 
DSAM  processes  operate  and  with 
which  they  interact 

—Which  report  problems  and  recom¬ 
mendations  and  identify  actions  to  be 
tracked,  progress  to  be  reported,  and 
information  to  be  continually  collected 
for  use  in  the  next  scheduled  periodic 
review. 

Then  information  aids  with  in¬ 
tegrated  current  information  from  suc¬ 
cessive  reports  of  each  periodic 
Presidential  Commission  review, 
augmented  by  information  about 
related  progress  and  problems  between 
reviews,  should  do  much  to  overcome 
the  insufficiency  of  past  ad  hoc  reports, 
supplementing  the  experience  of 
periodic  presidential-level  commis¬ 
sions.  and  better  assuring  substantial 
increases  in  defense  acquisition 
productivity. 

Summary  of  Insufficiencies 

One  of  my  research  objectives  is  to 
identify  past  insufficiencies  which  can 
be  remedied,  or  coped  with  better,  to 
increase  defense  acquisition  produc¬ 
tivity  substantially.  1  have  done  this. 
Many  insufficiencies  scattered 
throughout  the  article  stem  from 
similar  sources  and  need  the  same 
remedy.  To  help  identify  remedies  and 
aids  for  coping  better,  scattered  insuf- 
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ficiencies  are  organized  by  the  produc¬ 
tivity  elements  used  in  the  analysis  and 
summarized  below. 

Objectives  and  Strategy 

—Lack  of  DSAM  knowledge  and  in¬ 
formation  aids  to  help  DSAM  profes¬ 
sionals  design,  update,  and  implement 
an  acquisition  strategy,  or  to  oversee 
and  support  strategy  implementation 

— Failure  to  recognize  the  generality  of 
the  strategy  concept,  and  direct  every 
DOD  organization  primarily  involved 
in  defense  acquisition,  to  develop, 
maintain  and  implement  an  organiza¬ 
tion  strategy,  not  only  those  organiza¬ 
tions  that  acquisition  a  defense  system 

—  Failure  to  establish  a  government 
(DOD-Congress)  objective  to  manage 
changes  in  the  environment  of  defense 
systems  acquisition  so  that  public  and 
high-level  government  attention  is 
focused  on  overall  national  military 
objectives  and  strategies,  instead  of  on 
budget  line  items. 

Organizational  Processes 

—  Inability  to  deal  with  four  inter¬ 
related  problems  that  result  from  turn¬ 
overs  of  top  policy-makers,  and 
policy-influencers  in  Administrations 
and  the  Congresses 

—How  to  develop  truer  perceptions  of 
crucial  DSAM  issues  and  problems  to 
guide  development  of  sound  initiatives 
for  improving  and  integrating  DSAM 
processes 

—How  to  maintain  truer  perceptions 
of  discontinuities  that  result  from  turn¬ 
overs  of  Administration  policy-makers 
and  congressmen 

—  How  to  sustain  directed  acquisition 
improvement  initiatives  until  they  are 
institutionalized 

—How  to  foster  shared  truer  percep¬ 
tions  among  Administration  policy¬ 
makers  and  members  of  the  Congress 

—  Failure  to  comprehensively  review 
periodically  the  whole  DSAM  process 
and  its  environment,  with  objectives 
to: 

—  Identify  emerging  acquisition- 
management  issues  and  problems  for 
timely  policy-analysis,  decision,  and 
corrective  action  and,  thus, 


— Reverse  the  deterioration  of  relation¬ 
ships  between  government  and  the 
defense  industry,  and  the  loss  of  sup¬ 
port  for  adequate  national  defense  by 
a  disillusioned  public 

— Lack  of  aids  to  provide  each  DSAM 
professional  with  the  relevant  DSAM 
knowledge  and  information  when 
needed  in  a  job  or  task 

—Inability  to  induce  crucial  changes  in 
the  defense  management  culture,  and 
"manage"  constructive  change  in  the 
environment  of  defense  acquisition, 
both  critical  to  substantial  increase  in 
DSAM  productivity. 

Organizational  Structures 

— Insufficiency  of  "for  this  case  only" 
ad  hoc  reviews  to  solve  perennial  com¬ 
plex  organizational  structure  and  pro¬ 
cess  problems  due  to  lack  of  sched¬ 
uled  periodic  follow-up  to  make  ad¬ 
justments  and  assure  steady  progress 
on  the  recommended  improvements 

—Inability  of  ad  hoc  commissions, 
panels,  or  working  groups  to  include 
all  relevant  experience  needed  to 
foresee  all  crucial  effects  of  the 
organizational  structure  changes  they 
recommend,  on  all  acquisition  pro¬ 
cesses  affected  by  the  changes 

—Lack  of  DSAM  knowledge  and  in¬ 
formation  aids  that  can  supplement  the 
knowledge  and  experience  of  DSAM 
process  review  groups  to  improve  their 
recommendations  for  organizational 
structure  changes. 

This  list  of  insufficiencies  provides 
opportunities  and  valid  objectives  for 
improving  management  of  defense 
system  acquisitions.  Remedying  these 
insufficiencies  would  increase  the  pro¬ 
ductivity  of  DSAM  professionals  at  all 
levels  throughout  the  defense  acquisi¬ 
tion  community.  Then,  operating  in 
"centers  of  excellence"  in  a  supportive 
environment  (e.g.,  with  "shared  pur¬ 
pose  and  mutual  trust"  and  with  stable 
long-range  resource-constrained  plan¬ 
ning  and  budgeting)  as  envisioned  by 
the  President's  Commission,  DSAM 
professionals  could  increase,  not  just 
substantially  but  tremendously,  the 
productivity  of  the  DSAM  process. 

This  may  sound  idealistic,  but  if  we 
use  this  objective  to  guide  steadfast  in¬ 
novative  efforts  to  improve  the  defense 
acquisition  process,  we  can  make  pro- 
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gress  and  increase  acquisition  manage¬ 
ment  productivity  substantially.  The 
rewards  of  increased  DSAM  produc¬ 
tivity  will  be  great. 

Increasing  Productivity 
Substantially 

I  began  this  research  with  goals  to 
identify  past  proven  approaches  and 
successes  that  we  should  continue  to 
emulate  and  build  upon;  to  identify 
past  insufficiencies  that  we  can 
remedy;  and  to  explore  innovative  new 
ideas  and  concepts  for  building  on  suc¬ 
cesses  and  remedying  insufficiencies  to 
substantially  increase  productivity  in 
the  DSAM  process.  My  objective  is  to 
identify  management  improvements 
and  aids  which  would  be  sufficient  to 
increase  the  productivity  of  DSAM 
professionals  substantially— not  only 
individually,  but  also  collectively  in¬ 
teracting  in  organizational  and 
multiorganizational  DSAM  subpro¬ 
cesses. 

Consider  proven  approaches  first. 
One  has  been  to  increasingly  integrate 
major  DSAM  processes.  Two  out¬ 
standing  examples  of  successes  were 
the  development  of  the  PPBS  and  the 
DSARC  process  through  increased  in- 
tegation.  The  institution  of  the  new 
Defense  Acquisition  Board  (DAB)  to 
increase  PPBS-DSARC  integration 
through  user-aided  trade-offs  between 
system  cost  and  performance  is 
another  promising  example.  We 
should  build  upon  such  successes. 

We  should  continue  the  increased  in¬ 
tegration  approach  and  apply  it  on 
other  major  DSAM  processes;  for  ex¬ 
ample,  to  achieve  greater  integration 
of  DSAM  research  and  DSAM  infor¬ 
mation  processes  by  actively  involving 
users  in  a  direct  closed-loop  process 
(problem-identification,  research,  new 
information-distribution,  new  prob¬ 
lem-identification,  new  research).  Or, 
greater  integration  of  profit  policy, 
system  development  policy,  and 
defense  industrial  base  policy— in  an 
integrated  Defense  Industrial  Base 
Enhancement  (DIBE)  process — to  en¬ 
sure  future  capability  to  acquire 
superior  defense  systems,  and  future 
surge  and  mobilization  capability  in 
war  emergencies. 

Then,  DSAM  professionals  in¬ 
volved  in  more  integrated  DSAM  pro¬ 
cesses  would  act  more  in  unison  to 
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provide  adequate  defense  within 
available  resources.  Much  too  often  to¬ 
day,  due  to  its  large  scope  and  com¬ 
plexity,  the  DSAM  process  appears  to 
reflect  different  collections  of  indepen¬ 
dent  organisms.  Each  with  its  own  pro¬ 
fessional  subculture  seems  to  work  at 
wasteful  cross-purposes  in  support  of 
the  common  objective,  adequate  na¬ 
tional  defense.  For  example,  contrac¬ 
ting  officers  and  auditiors,  operating 
in  different  DOD  Acquisition  and 
DOD  Inspector  General  hierarchies, 
often  seem  to  work  at  cross  purposes 
in  motivating  maximum  contractor 
productivity,  and  in  developing  an  en¬ 
vironment  of  shared  purpose  and 
mutual  trust.  Other  functional  groups 
seem  to  work  at  cross  purposes  trying 
to  reduce  government  acquisition  risks 
in  the  short  term  and  maintain  a  viable 
defense  industrial  base  in  the  long  run. 

Consider  the  list  of  insufficiencies 
next.  Analysis  as  to  cause  shows  they 
generally  fall  into  two  groups:  failures 
to  recognize  a  need,  and  to  act  produc¬ 
tively  to  meet  the  need;  or  inabilities 
to  act  productively,  either  due  to  lack 
of  timely  relevant  DSAM  knowledge 
or  information,  or  due  to  the  present 
environment  of  defense  acquisition. 
New  policy  direction,  or  DOD- 
Congress  cooperation  in  matters  in¬ 
volving  both  the  Congress  and  the  Ad¬ 
ministration,  can  remedy  the  failure  in¬ 
sufficiencies.  However,  to  remedy 
those  insufficiencies  which  result  from 
inabilities,  we  need  innovative  new 
ideas,  concepts  and  approaches. 

I  propose  further  exploration  of  two 
new  approaches,  one  concerned  with 
each  kind  of  inability.  My  research  to 
date  indicates  these  approaches  could 
help  remedy  both  inabilities  and 
substantially  increase  productivity  in 
DSAM  processes.  The  approaches  are: 

—  Providing  DSAM  knowledge  and  in¬ 
formation  aids  that  can  increase  great¬ 
ly  the  productivity  of  each  DSAM  pro¬ 
fessional,  substantially  increasing  pro¬ 
ductivity  of  their  organizations,  and 
thus,  of  the  whole  DSAM  process 

—  Achieving  constructive  changes  in 
the  present  environment  of  the  DSAM 
process  within  which  DSAM  processes 
function  and  with  which  they  interact, 
including  positive  changes  in  the  pre¬ 
sent  adversarial  defense  management 
culture.  These  changes  are  prere¬ 


quisites  to  achieving  substantial  in¬ 
creases  in  acquisition  management 
productivity. 

These  new  approaches  and  the 
already  proven  approach  of  increasing 
integration  are  highly  interdependent. 
Significant  progress  in  intergrating  ma¬ 
jor  DSAM  processes  depends  on  DOD 
ability  to  "manage"  constructive 
change  of  the  environment  of  defense 
acquisition.  However,  substantial  pro¬ 
gress  in  both — increased  integration, 
and  management  of  constructive 
changes  of  the  environment — depend 
on  development  of  better  DSAM 
knowledge  and  information  aids. 

We  urgently  need  progress  on  all 
three  fronts  to  increase  productivity 
substantially  in  acquisition  of  defense 
systems.  We  must  begin  now  to 
develop  more  relevant  DSAM 
knowledge,  information  and  commun- 
ciation  aids  that  are  more  easily  and 
selectively  accessible  by  DSAM  profes¬ 
sionals  to  increase  productivity  :n  their 
jobs  and  in  tasks  at  hand.  This  is  a 
prerequisite  to  progress  on  the  other 
two  fronts. 
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11  major  military 
-  systems  developed 
during  this  decade  use  or  will 
use  some  type  of  computer 
system  in  their  architec¬ 
ture.1  In  U.S.  Army 
communications-electronics 
(C-E)  systems,  the  majority 
of  product  improvements, 
and  performance  enhance¬ 
ments  will  come  from  the 
inclusion  of  computer  soft¬ 
ware.  Currently,  the  clear 
majority  of  C-E  programs 
have  a  significant  software 
development  effort  as  part  of 
the  system  acquisition.  The 
distinctive  nature  of  soft¬ 
ware,  and  the  methods  by  which  it  is  developed,  make  soft¬ 
ware  acquisition  unique  to  the  normal  weapon  system  life- 
cycle  management  process. 

The  Department  of  Defense  has  used  computers  and  the 
attendant  software  since  the  early  first-generation  com¬ 
puters.  Major  emphasis  until  the  late  1970s  had  been  on 
hardware  due  to  the  stand-alone  nature  and  employment 
of  computers  on  weapon  systems.  At  the  end  of  the  last 
decade,  emergence  of  the  integrated  circuit  and,  in  par¬ 
ticular,  the  very  high  speed  integrated  circuit  (VHSIC), 
allowed  the  widespread  implantation  of  computer  resources 
within  other  operating  systems.  As  the  use  of  VHSIC  became 
greater,  so  did  reliance  on  software  to  drive  the  circuitry. 
Software  on  DOD  systems  is  reflected  by  its  expected  $30 
billion  investment  in  mission-critical  software  by  1990. 2 

Increased  dependence  on  embedded  computers  in  C-E 
weapon  systems  has  increased  to  the  point  where  the  user 
cannot  diagnose  problems  as  they  occur.3  Thus,  as  the  use 
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of  embedded  computer 
systems  increases,  so  too 
must  there  be  an  emphasis 
on  delivering  the  most 
reliable,  lowest  cost 
and  schedule  conforming 
software.  The  current 
defense  acquisition  process  is 
replete  with  examples  of 
expensive  weapons  which 
don't  perform  as  envisioned, 
and  require  extensive  post¬ 
production  modifications.  In 
the  context  of  a  complicated 
and  lengthy  procurement 
system,  this  paper  seeks  to 
develop  and  recommend  a 
software  testing  manage¬ 
ment  guide  to  reduce  some  software  testing  problems. 
Therefore,  the  guiding  theme  is:  "How  can  the  software 
testing  process  be  managed  to  improve  weapon  system 
acquisition?" 

This  paper  is  constructed  to  develop  a  baseline  of  infor¬ 
mation  on  software  testing  management  through  a  discus¬ 
sion  of  program  manager  issues,  terms  and  methodology 
used  in  software  testing,  relationship  of  software  and  hard¬ 
ware  development,  software  cost  estimating  techniques,  and 
concludes  wtih  a  program  manager  checklist  on  software 
testing  management. 

Program  Manager's  Problem 

The  program  manager  is  faced  with  the  dilemma  of  how 
to  produce  a  software  package  meeting  the  user's  needs  or 
specifications  at  an  acceptable  level  of  confidence,  which 
cannot  be  tested  completely  and  with  certainty.  A  counter 
question  becomes,  given  these  conditions:  How  does  the  pro- 
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gram  manager  assure  himself  of  the 
software's  reliability  and  quality  of 
conformance? 

Few,  if  any,  military  projects  are 
exclusively  concerned  with  software  as 
a  separate  entity.  Weapon  system  pro¬ 
gram  managers  must  concurrently 
develop  both  the  hardware  and  soft¬ 
ware  as  the  system  progresses  through 
each  phase  of  the  acquisition  process. 
Attempting  to  balance  cost,  schedule, 
and  logistics  with  the  highest  attainable 
operational  availability  relies  on  the 
extent  and  validity  of  software  testing 
before  system  issuance  to  the  opera¬ 
tional  forces. 

Program  Manager  Guidance 

Several  authors  contend  that  a 
major  portion  of  the  difficulty  in 
managing  software,  especially  for 
DOD  program  managers,  is  the  lack  of 
clear  policy  from  the  government 
regarding  software  quality  and  soft¬ 
ware  quality  assurance.4  This  is  com¬ 
pounded  by  the  few  restrictions  placed 
on  software  project  managers  due  to 
the  great  deal  of  latitude  when  tailor¬ 
ing  or  interpreting  them.5 

The  need  for  software  testing  and 
software  quality  standards  was 
recognized  in  1982  and  two  DOD 
documents  were  produced  to  over¬ 
come  the  ambiguity  of  the  then-current 
guidance.  The  DOD  Standard  2167 
(Defense  System  Software  Develop¬ 
ment)  is  the  authoritative  guidance  for 
software  development,  and  DOD 
Standard  2168  (Draft)  (Software 
Quality  Assurance)  is  the  guide  for 
product  assurance  and  test  guidance. 
An  earlier  standard,  MIL  Standard 
1679  (Weapon  System  Software 
Development),  was  the  definitive 
publication  before  DOD  2167  and 
2168.  Many  current  programs  still  use 
requirements  of  MIL  STD  1679  since 
this  was  the  guidance  in  effect  when 
the  programs  began. 

Background  on  Software  Project 
Management 

As  a  basis  for  discussion  on  the  pro¬ 
gram  manager's  decision  methodol¬ 
ogy,  a  brief  background  of  software 
project  management  considerations  is 
presented.  The  project  manager  must 
be  conversant  in  such  topical  areas  as 
software  reliability,  embedded  com- 
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puter  software  and  hardware,  pro¬ 
blems  inherent  in  managing  a  soft¬ 
ware/hardware  combination  project, 
and  different  types  of  software  life- 
cycle  models. 

Software  Reliability 

A  variety  of  articles  and  texts  have 
been  written  in  the  past  several  years 
in  an  attempt  to  produce  a  model, 
heuristic,  or  procedure  which  will 
either  completely  verify  software's 
accuracy  or  determine  an  achieved 
reliability  rate.  Although  not  a  perfect 
analogy,  software  reliability  may  be 
compared  to  hardware  reliability  in 
that  the  reliability  index,  or  mean  time 
between  failure  (MTBF)  can  be  defined 
as  the  probability  that  the  software  will 
perform  its  intended  function  for  a 
prescribed  time  under  a  set  of  specified 
conditions. 

Three  terms  commonly  used  in 
referring  to  software  reliability  are 
reliability,  quality  assurance,  and 
verification  and  validation  (V&V). 
Each  represents  a  concept  which 
overlaps  the  other  to  some  degree; 
thus,  quality  assurance  in  one  project 
may  be  considered  testing  in  another. 
Regardless  of  the  word  used,  the 
essence  in  assessing  software  reliabil¬ 
ity  is  the  degree  and  extent  of  software 
testing. 

Embedded  Computer 
Software/Hardware 

Software,  especially  in  military 
applications,  is  part  of  larger,  more 
intricate  systems.  This  firmware  or 
embedded  software  is  a  subset  of 
systems  software,  and  is  the  most  com¬ 
mon  type  of  software  in  military 
systems.  The  DOD  Standard  2167 
defines  firmware  (embedded  hard¬ 
ware/software)  as  the  combination  of 
both  the  hardware  and  software  that 
reside  as  read-only  software  on  the 
hardware  device.6 

The  concept  of  embedded  computers 
implies  that  the  user  expects  a  certain 
level  of  system  performance  to  occur 
under  a  given  set  of  conditions,  pro¬ 
vided  the  software  is  functioning  prop¬ 
erly.  This  absence  of  unexpected  errors 
should  lead  to  user  satisfaction. 
Dr.  Michael  Paige  identifies  four 
events  which  the  user  expects  to  have 
minimized  through  identification  and 


correction  of  software  errors: 

— No  unexpected  behaviors  at  either 
the  system,  or  functional  levels 
—No  loss  of  data 
— No  unrecoverable  events 

—  No  incorrect  functional  oper¬ 
ations.7 

In  theory,  satisfaction  of  these  four 
criteria  should  assure  the  program 
manager  and  user  that  the  embedded 
software  can  be  operated  with  con¬ 
fidence.  Yet,  it  is  these  same  goals 
which  become  elusive  in  software 
quality  assurance  and  testing. 

One  approach  represents  a  testing 
philosophy  rather  than  a  test  pro¬ 
cedure.  Dr.  Paige  has  developed  a 
priority  schema  which  outlines  a 
technique  and  sequence  to  reduce  soft¬ 
ware  errors  through  prioritizing  the 
testing  effort.8  In  it,  fatal  errors  are 
given  top  priority,  while  nuisance  bugs 
are  lowest.  The  testing  effort  from  pro¬ 
gram  inception  is  directed  toward 
reducing  this  hierarchy  of  program 
errors  until  the  software  can  be  uncon¬ 
ditionally  released.  This  represents  a 
simple  strategy,  but  also  a  very  effi¬ 
cient  method  of  conducting  software 
quality  assurance. 

Hardware  and  Software  Problems 

Most  of  the  CECOM  managed  pro¬ 
grams  have  a  high  degree  of  software 
and  hardware  integration,  with  pro¬ 
gram  managers  being  responsible  for 
both.  A  major  portion  of  the  program 
manager's  interest  lies  in  reliability  of 
software.  However,  two  different 
management  strategies  are  needed  as 
there  are  significant  differences 
between  the  hardware  and  software 
development.  Rook  describes  some  of 
the  more  distinct  differences  as: 

—  Software  has  no  physical 
appearance 

— Few  software  quality  metrics  exist 

—  Software  is  more  complex  than 
hardware 

—  Effects  of  change  in  software  pro¬ 
pagate  explosively 

—  Software  makes  very  little  use  of 
preexisting  components.9 

In  addition  to  the  actual  differences 
between  hardware  and  software,  there 
are  differences  in  their  management. 
Program  managers  have  developed  a 
great  deal  of  expertise  in  managing 
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hardware  development  and  acquisi¬ 
tion.  However,  successful  software 
projects  are  predicated  upon  a  different 
set  of  criteria  than  hardware. 
Wingrove  cites  six  major  problems 
which  influence  software  projects: 

—  Rapidly  changing  technology 

—  Difficulties  in  resource  and  cost 
estimation 

—  Inability  to  predict  and  measure 
reliability 

—  A  lack  of  agreement  on  test  metrics 
—Problems  with  software  and  equip¬ 
ment  interfacing 

—  Problems  with  integration  of  dif¬ 
ferent  parts  of  the  software  package.10 

In  DOD  weapon  system  acquisition, 
the  problems  of  hardware  and  soft¬ 
ware  integration  are  compounded  by 
the  length  of  the  acquisition  process 
where  relative  technologies  of  hard¬ 
ware  and  software  improve  at  a  much 
faster  rate  than  the  overall  program 
can  manage.  In  fact,  the  rate  at  which 
the  hardware  technology  and  improve¬ 
ments  develop  seldom  paces  the  soft¬ 
ware  enhancements.  This  difference  in 
hardware  and  software  development 
schedules  causes  obsolescence  or,  at 
least,  continuous  turmoil  in  the  soft¬ 
ware  and  in  the  system's  develop¬ 
ment.11 

Software  Project  Management 

Due  to  the  nature  and  complexity  of 
a  hierarchy  of  prime  and  subcontrac¬ 
tors,  the  program  management  office 
may  be  considerably  distanced  from 
the  inner  workings  of  the  software 
developing  contractor's  activity.  Fur¬ 
thermore.  they  have  little  visibility  into 
the  developmental  test  and  evaluation 
process  employed  by  the  contractor.12 
By  not  being  able  to  monitor  and 
evaluate  the  test  and  evaluation  effort, 
the  responsible  agency  places  a  much 
higher  degree  of  faith  in  the  contrac¬ 
tor's  intern'!  software  quality  control 
and  assurance. 

Although  the  program  management 
office  may  deal  exclusively  with  the 
developing  contractor,  a  separate 
team,  usually  a  separate  contractor, 
conducts  the  independent  verification 
and  validation  (IV&V).13  This  IV&V 
function  is  the  responsibility  of  a 
separate  independent  testing  office 
(ITO).  In  performing  its  function,  the 
ITO  maintains  a  healthy  adversarial 
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relationship  with  the  developing  con¬ 
tractor  through  its  conduct  of  tests  and 
reporting  of  test  discrepancies.14  A 
more  in-depth  discussion  on  the  role 
and  function  of  the  IV&V  contractor 
is  presented  later  in  this  paper. 

Software  projects,  by  themselves, 
are  difficult  to  manage  and  extensive 
problems  may  arise  when  software 
becomes  part  of  a  larger  project.  Hard¬ 
ware  and  software  project  manage¬ 
ment  becomes  more  difficult  when  the 
program  manager  is  neither  a  hard¬ 
ware  nor  software  specialist.15  Risks 
associated  with  software  development 
increase  as  the  software  itself  moves 
toward  new  technology  and  away 
from  re-use  or  transferred  technology. 
In  many  systems,  the  software  has 
overtaken  hardware  as  the  dominant 
part  of  the  project.16 

Other  factors  have  compounded 
management  of  software  projects. 
Software  programs  have  increased 
their  burden  on  the  project  manage¬ 
ment  through  system  cost  overruns  as 
the  result  of  the  soaring  cost  of  soft¬ 
ware  development  and  support.17  One 
major  cost  impact  is  the  high  cost  of 
software  directly  related  to  difficulties 
in  defining  requirements. 

Performance  criteria  for  software 
depends  on  the  degree  of  conformance 
to  specified  requirements.  Problems  in 
software  management  stem  from  poor 
requirements  definition,  weak  manage¬ 
ment,  the  inherent  size  and  complex¬ 
ity  of  the  system,  and  a  critical  short¬ 
age  of  software  professionals.18  Thus, 
estimating  project  size  and  duration  is 
a  difficult  undertaking.19 

A  further  issue  in  the  management 
of  software  projects  is  the  lack  of  clear 
and  consistent  guidance  to  the  pro¬ 
gram  manager.  This  void  ranges  from 
incomplete  topical  coverage  in  military' 
standards  to  guide  the  IV&V  efforts  to 
the  contention  that  specific  guidance  is 
overused.20  For  projects  which  must 
integrate  hardware  and  software,  there 
appears  to  be  a  void  of  guidance  on 
how  to  integrate  its  development.  Fur¬ 
thermore,  efforts  devoted  to  rectifying 
this  situation  may  not  catch  up  with 
the  natural  technological  evolution  in 
the  mission  critical  computer  resources 
discipline.  In  light  of  this  situation, 
available  guidance  on  how  to  manage 
software  projects  tends  to  be  scattered, 
diffuse,  and  sometimes  confusing.21 
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Software  Life-Cycle  Models 

Software  projects  follow  an  iterative 
development  which  begins  with  the 
software  portion  of  the  system  require¬ 
ments.  One  way  to  represent  this  pro¬ 
cess  is  Boehm's  "Waterfall"  model;  it 
shows  software  development  from 
requirements  definition  through  design 
phases,  coding,  integration,  and  even¬ 
tually  into  an  operations  and 
maintenance  phase.22  An  example  of 
the  "Waterfall"  model  is  shown  as 
Figure  1. 

The  "Waterfall"  model  is  used  exten¬ 
sively  in  software  engineering 
literature  and  in  DOD  standards  and 
guidance.  An  alternative  model  is  pro¬ 
posed  by  Klucas  which  displays  the 
software  development  process  in  six 
phases: 

— Requirements  Analysis 
— Preliminary  Design 
—Detailed  Design 
—  Code  and  Unit  Testing 
— Software  Integration  and  Testing 
—Software  Performance  Testing.23 

Other  authors  have  proposed 
modifications  or  different  representa¬ 
tions  of  Boehm's  model,  but  the  essen¬ 
tial  elements  are  the  same.  The  In¬ 
stitute  of  Electrical  and  Electronics 
Engineers  (IEEE)  adds  a  retirement 
phase,  while  Booch  places  more 
emphasis  on  the  requirements  phase.24 

Software  Testing 

Software  testing  is  usually  done  in 
an  iterative  process  beginning  with  a 
strong  emphasis  on  the  proper  defini¬ 
tion  of  the  user's  need,  further  refined 
into  requirements  statements.  This 
concerns  types  and  sequence  of  soft¬ 
ware  testing,  test  phases,  and  dif¬ 
ferences  between  parametric  and 
empirical  software  testing. 

Types  and  Sequence  of  Testing.  All 
software  testing  assumes  the  require¬ 
ments  and  the  user's  needs  have  been 
adequately  stated  from  which  test 
criteria  can  be  written.  Software 
testing  is  structured  into  two  types, 
verification  and  validation. 

Verification  is  the  first  testing  step 
in  minimizing  unexpected  errors.  The 
verification  function  tests  the  operating 
code  to  assure  the  software  developer 
that  the  program  functions  as 
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designed.  While  simple  in  concept,  the 
difficulty  in  testing  a  simple  embedded 
software  program  can  be  shown  in  an 
example  in  which  a  block  of  executable 
code  is  written  to  monitor  and  correct 
a  temperature  sensing  control. 

With  only  a  hundred  lines  of  code 
and  five  possible  paths,  this  sub¬ 
program  would  require  about  12,000 
iterations  to  test  for  proper  execution . 
Depending  upon  where  in  the  software 
test  cycle  this  verification  is  conducted, 
40  or  more  errors  could  be  found.  This 
method  is  clearly  inadequate  when  the 
system  software  contains  hundreds  of 
thousands,  or  even  millions,  lines  of 
code. 

Thus,  testing  all  possible  combina¬ 
tions  of  path  and  code  isn't  feasible  for 
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most  applications.  Because  of  various 
hidden  paths  and  the  injection  of  pro¬ 
gramming  creativity,  even  if  the  pro¬ 
gram  could  be  completely  line-and- 
path  tested,  there  is  no  guarantee  the 
program  will  run  error-free  each  time 
it  is  executed. 

The  verification  function  systemat¬ 
ically  checks  path  and  code  correct¬ 
ness,  but  does  not  assure  the  user  of 
program  application  and  usefulness. 
This  is  the  function  of  validation. 

Validation  is  the  second  step  in  the 
software  development  process  begin¬ 
ning  when  agreement  can  be  reached 
on  the  verification  testing.  This  phase 
of  testing  consists  of  translation,  com¬ 
plete  understanding,  execution,  and 
feedback  to  the  project  manager  that 


the  software  performs  as  intended. 
Furthermore,  validation  testing  essen¬ 
tially  assures  the  user  that  the  software 
meets  his  stated  needs.25  When  valida¬ 
tion  testing  is  performed  under  formal 
test  guidelines,  this  is  known  as  inde¬ 
pendent  verification  and  validation 
(IV&V). 

There  are  many  techniques  to  per¬ 
form  validation  testing.  These  range 
from  a  relatively  simple  set  of 
managerial  rules  to  a  sophisticated 
stochastic  model  of  software  errors,  all 
of  which  assume  a  common  denomi¬ 
nator  of  correctly  stated  requirements. 
Several  of  these  techniques  are 
generalized  below. 

—Design  walk-through.  A  separate  set 
of  experts  systematically  examine  the 
code  and  its  execution  to  detect  design 
and  execution  flaws.26 
— Design  inspection  process.  The 
design  is  reviewed  by  the  program 
author's  peers,  recommendations  are 
recorded,  and  software  development 
folders  maintained.27 
—Automatic  test  drivers.  Uses  a 
designed  data  base  of  "bugs"  and  co¬ 
processes  the  test  driver  with  the  code. 
Reliability  is  inferred  by  the  failure  rate 
measured  by  the  number  of  hits  the 
code  makes  on  the  database.28 
—Stochastic  mathematical  deriva¬ 
tions.  Examines  the  output  and  draws 
reliability  inferences  from  that 
output.29 

The  most  frequent  procedure  is  to 
use  a  combination  of  two  or  more  of 
these  techniques  to  validate  the  entire 
program  design  and  code.  As  the  soft¬ 
ware  test  process  moves  from  a  deci¬ 
sion  point  of  whether  or  not  the  code 
executes  properly  (verification),  to  a 
point  of  complete  usefulness  (valida¬ 
tion),  the  more  subjective  and  random 
the  test  method.  Verification  and 
validation  are  not  successive,  exclusive 
steps,  but  integrated  levels  of  con¬ 
fidence.  Unfortunately,  the  pivotal 
question  of  how  realistically  and  com¬ 
pletely  to  test  for  both  types  has  not 
been  universally  agreed  upon. 

Software  Testing  and  Test  Phases 

Given  that  verification  and  valida¬ 
tion  3re  essential  elements  of  any  soft¬ 
ware  test,  the  program  manager  must 
integrate  these  functions  into  the  actual 
software  testing  process. 
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Software  testing,  as  defined  by  Goel, 
is  the  symbolic  or  physical  execution 
of  a  set  of  test  cases  with  the  intent  of 
exposing  embedded  faults  in  the  pro¬ 
gram,  Regardless  of  the  extent  of  soft¬ 
ware  testing,  it  is  an  imperfect  tool  for 
assuring  program  correctness.30 
Janusz  lists  four  types  of  software  test 
methods  to  assist  in  determining  how 
well  the  program  is  functioning 
according  to  the  test  requirements: 

—  Static  and  Dynamic 
—Set  Theory  Analysis 

—  Graph  Theory 

—  Structured  Testing.31 

Software  testing  is  an  iterative  pro¬ 
cess  done  in  phases.  Each  of  the 
phases:  unit,  module,  integration,  and 
acceptance  testing  builds  upon  the 
previous  phase  to  eventually  determine 
if  one  or  more  of  the  stated  require¬ 
ments  has  been  met.  A  brief  descrip¬ 
tion  of  each  test  phase  is  described 
below. 

Unit  testing  is  verification  of  the 
written  code,  usually  done  informally, 
which  becomes  more  formalized  <d  the 
test  process  is  expanded.32  Further¬ 
more,  aspects  of  unit  testing  are  that 
it  is  usually  the  responsibility  of  one 
programmer,  and  it  is  the  lowest  level 
of  a  module  independently  docu¬ 
mented  and  controlled  in  the 
system.33 

Module  testing  is  the  testing  of  an 
individual  module  before  being  com¬ 
bined  with  other  modules.  A  module 
is  an  element  of  the  overall  program 
which  can  be  separately  identified,  and 
usually  performs  a  particular  function. 
A  unit  is  the  lowest  (smallest)  type  of 
module.  This  type  of  testing  is  done 
typically  by  the  developing  pro¬ 
grammers.34 

Software  Module  Integration  testing 

is  the  process  of  adding  a  new  module 
to  the  evolving  software  system, 
testing  this  new  combination,  and 
repeating  this  process  until  the  entire 
system  has  been  brought  together  and 
thoroughly  tested.35  Integration 
testing  follows  module  testing  and  is 
designed  to  test  the  performance  of  the 
software  to  demonstrate  complete  pro¬ 
cessing  functions.  Integration  testing  is 
usually  done  at  the  contractor's  facil¬ 
ity.3*  If  test  cases  are  used  to  conduct 
integration  testing,  they  may  be 
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generated  either  stochastically  or 
deterministically.37 

The  objective  of  integration  testing 
is  the  interface  between  modules,  with 
the  focus  being  the  exposure  of  integra¬ 
tion  defects.  One  theory  of  integration 
testing  is  to  only  test  the  connection 
between  modules;  unfortunately, 
faults  are  often  buried  within  each 
module's  own  internal  operation.38 
For  this  reason,  it  is  infeasible  to  turn 
integration  testing  over  to  an  indepen¬ 
dent  test  team39  and  this  phase  of 
testing  is  done  best  by  the  group  which 
also  has  the  programming  respon¬ 
sibility.40 

DeMillo  found  that  the  decision  on 
how  much  integration  testing  is 
necessary  and  sufficient  is  usually  a 
subjective  one.  Furthermore,  the  basis 
of  integration  test  completion  depends 
upon  the  continuous  execution  of  the 
test  code  to  verify  correction  of  the 
errors.41  This  continuous  execution  of 
the  code  is  done  through  preliminary 
qualification  testing  (PQT).42 

Acceptance  testing  is  the  final  phase 
of  the  software  test  process  which 
occurs  before  system  testing  (hardware 
and  software  integration)  to  demon¬ 
strate  complete  processing  functions. 
Regardless  of  the  degree  of  testing  done 
at  lower  levels  (unit,  module,  integra¬ 
tion),  some  errors  will  remain  until  soft¬ 
ware  system  test-out.43  The  basis  of 
whether  the  software  has  met  the 
requirements  of  the  acceptance  test  is 
determined  by  the  conformance  to  test 
specifications.  Thus,  acceptance  testing 
should  be  done  under  conditions  agreed 
to  by  the  user;  the  objective  being  to 
demonstrate  that  the  system  satisfies 
contractual  requirements. 

Parametric  or  Empirical  Testing 

Conferences  and  proceedings  have 
been  held  to  define  and  decide  exactly 
what  degree  of  testing  will  meet  the 
confidence  level  requested  by  the  user. 
However,  these  have  met  with  limited 
success.  Hall,  quoting  findings  of  the 
State-of-the-Art  Overview,  reports: 

—There  are  no  general-purpose,  valid 
and  reliable  test  selection  procedures 
—There  is  no  conclusive  proof  on 
whether  or  not  software  can  be  proved 
correct 

—  Data  are  not  available  on  com¬ 


parative  test  methodologies  for  large- 
scale  development  efforts.44 

Decisions  regarding  the  degree  and 
complexity  of  the  software  testing  must 
be  made  early  in  the  project.45  Essen¬ 
tially,  there  are  two  fields  of  thought 
on  how  to  define  the  testing  process  en¬ 
vironment.  The  first  position  relies  on 
a  set  of  assumptions  which  must  be  ap¬ 
plied  to  the  software  testing  process  to 
establish  sample  parameters  and  con¬ 
struct  a  forecast  of  software  testing 
faults. 

The  second  viewpoint  contends  that 
software  should  be  completely  fault 
tested  (stress  tested)  with  all  possible 
inputs  and  operating  environment  vari¬ 
ables  allowed  to  run  their  range  In  light 
of  safety  and  criticality  of  mission,  this 
second  view  is  the  one  the  DOD  prefers 
in  its  testing  requirements. 

Dr.  Amrit  L.  Goel  supports  the  first 
position,  parametric  testing,  with  seven 
assumptions  under  which  software 
testing  is  conducted: 

—No  new  faults  are  introduced  during 
the  fault  removal  process 
—Failure  rate  decreases  with  time 
— Failure  rate  is  proportionate  to  the 
number  of  remaining  faults 
—Reliability  is  a  function  of  the 
number  of  remaining  faults 
—Time  is  used  as  a  basis  for  failure  rate 
—  Failure  rate  decreases  between 
failures 

— Testing  is  representative  of  opera¬ 
tional  usage.46 

Satisfaction  of  each  of  these  points 
results  in  a  decreasing  exponential  curve 
of  failure  incidence.  Although  these 
assumptions  will  lead  to  a  clean  and 
decisive  test,  they  do  not  provide  the 
necessary  confidence  either  to  the  pro¬ 
gram  manager  or  the  user  that  the  soft¬ 
ware  and,  in  turn,  the  system  may  be 
used  without  concern  of  random 
failure. 

The  DOD  requires  that  all  of  its  soft¬ 
ware  projects  be  put  through  a  partial 
stress  test  (empirical  test)  before  accep¬ 
tance.  Through  Military  Standard  (MIL 
STD)  2168  (Software  Quality 
Assurance)  and  1679  (Weapon  System 
Software  Development),  the  DOD 
requires  software  to  undergo  stress 
testing  for  a  representative  percentage 
of  the  executable  code.  The  stress 
testing  concept  consists  of  the  execution 
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of  a  complete  program  to  the  designed 
limits  of  its  capacities  and  beyond  in 
order  to  ensure  that  program  failure  is 
not  catastrophic. 

Parametric  testing  and  empirical 
testing  viewpoints  differ  in  several 
critical  areas,  the  most  important  being 
a  test  which  is  representative  of  opera¬ 
tional  usage.  The  concept  of  stress 
testing  implies  complete  line  and  path 
testing;  however,  in  practice,  this 
approach  is  unable  to  completely 
uncover  every  single  fault  or  failure. 
Thus,  some  of  Dr.  Goel's  assumptions 
must  be  allowed.  While  "total  reliabil¬ 
ity"  is  sacrificed,  the  final  result  is  soft¬ 
ware  which  cannot  be  certified  as  true 
and  proved,  but  can  be  indexed  with 
an  expected  mean  time  between  failure. 
It  is  at  the  point  where  software 
reliability  and  probability  of  mission 
critical  failure  intersect  that  the  pro¬ 
gram  manager  has  reached  a  position 
of  software  testing  optimization. 

Independent  Verification  and 
Validation 

Each  element  of  the  test  process 
whether  unit,  integration,  or  accep¬ 
tance,  involves  two  types  of  analysis; 
verification  and  validation.  Within  the 
development  effort,  the  contractor  or 
software  developer  will  perform  a  series 
of  preliminary  tests  to  conduct  informal 
unit,  module,  or  integration  tests. 

Formal  verification  and  validation 
analysis  may  be  applied  to  any  phase 
of  the  software  test  effort;  however, 
they  are  usually  conducted  during  the 
later  phases  as  independent  verification 
and  validation  (IV&V).47  The  IV&V 
effort  may  be  the  responsibility  of  the 
developing  contractor,  the  indepen¬ 
dent  IV&V  contractor,  or  a  combina¬ 
tion  of  the  two.  Within  the  contractor’s 
activity,  the  IV&V  effort  is  distributed 
among  three  line  organizations: 
systems  engineering,  software  develop¬ 
ment,  and  the  ITO  (Independent 
Testing  Office).48  To  assure  indepen¬ 
dence  and  objectivity,  the  ITO  office 
and,  in  turn,  the  IV&V  function  should 
not  be  part  of  the  developing  contrac¬ 
tor's  activity,  but  under  the  govern¬ 
ment  or  a  separate  contractor.  It  is  the 
sense  of  independence  which  must  be 
preserved  in  the  IV&V  process,49  and 
these  separate  independent  tests  must 
be  accomplished  before  release  to  the 
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user.50  Results  of  the  ITO  test  efforts 
are  listed  as  discrepancies  in  test 
reports.51 

Further  support  for  use  of  an  inde¬ 
pendent  test  agency  is  provided  by 
Deutsch  who  lists  these  three  reasons: 

— Engineering  of  a  test  program  is  a 
major  task 

—An  independent  test  organization 
preserves  objectivity 
— Cost  of  test  effort  can  exceed  that  of 
the  software  construction. 

Role  of  the  ITO  will  vary  from  pro¬ 
ject  to  project.  The  ITO  may  follow 
the  software  development  effort  from 
requirements  analysis  through  system 
acceptance  testing  for  large,  complex 
projects.  For  smaller  and  focused 
efforts,  the  ITO  may  elect  to  conduct 
formal  testing,  beginning  with  integra¬ 
tion  testing.  Basic  elements  for  which 
the  ITO  is  responsible  are  as  follows: 


#  isibility  and 
scope  of  work  must  be 
addressed  to  reduce 
friction  and  enhance 
productivity  .  .  . 


—  Ensure  all  performance  and 
maintenance  requirements  are  met 
—The  engineering  of  test  program  is 
consistent  with  lowest  life-cycle  cost 
— May  be  responsible  for  integration 
of  products  into  the  system  config¬ 
uration 

— Responsible  for  formal  qualification 
testing  of  each  computer  program  con¬ 
figuration  item  (CPCI) 

— Prepares  draft  test  procedures  for  in  ¬ 
tegration  tests,  updates  CPCI  test 
plans,  and  updates  the  system  test 
plan.52 

Not  all  IV&V  testing  is  done  by  the 
government  ITO.  This  function  usu¬ 
ally  is  transferred  to  a  separate  IV&V 
contractor  if  the  project  is  large,  com¬ 
plex,  or  critical  to  the  degree  where  a 
software  failure  would  be  catastrophic. 
The  IV&V  contractor  may  be  known 
as  the  system  integrating  contractor, 
according  to  Dem«rh  who  cavs  the 
following  are  functions  which  a  pro¬ 


gram  manager  would  expect  the  IV&V 
contractor  to  perform  on  unit,  module, 
integration  and  CPCI  software  testing: 

— Review  and  critique  test  programs, 
plans  and  methods 
— Participate  in  formal  reviews  and 
audits 

— Monitor  developer's  integration 
activities 

—  Integrate  developer's  products  into 
system  products. 

Deutsch  provides  one  caution  in 
having  a  separate  IV&V  contractor 
perform  IV&V  testing;  that  is,  relation¬ 
ship  between  the  two  is  at  best  fragile, 
and  the  IV&V  contractor  must  focus 
on  substantial  and  relevant  discrepan¬ 
cies.  Special  care  must  be  taken  when 
the  IVV  effort  itself  is  extensive  and  the 
IVV  contractor  may  become  a  com¬ 
petitor  of  the  developing  contractor. 
The  visibility  and  scope  of  work  must 
be  addressed  to  reduce  friction  and 
enhance  productivity  between  the  two 
contractors. 

Other  Considerations 

Besides  actual  planning,  conduct, 
and  review  of  software  tests,  other 
aspects  of  software  development  and 
corresponding  testing  should  be  con¬ 
sidered.  Among  these  are  error  to  test 
relationship,  real  time  systems,  and 
automated  testing. 

Error  to  Test  Relationship.  Janusz 
contends  one  principal  reason  for  the 
high  cost  of  software  is  the  difficulty 
of  the  error  removal  process.53  Of 
critical  importance  is  the  place  or  time 
the  error  is  discovered.  If  a  fault  is 
found  and  fixed  early  in  the  develop¬ 
mental  phase,  it  only  costs  five  percent 
of  what  this  same  error  correction 
would  cost  in  the  operational  phase. 
Moreover,  faults  indentified  during 
early  phases  can  reduce  residual  faults 
by  more  than  20  to  1.  Unfortunately, 
the  principal  procedure  to  conduct  this 
fault  identification  is  the  IV&V  test. 
This  is  particularly  critical  considering 
the  cost  of  conducting  IV&V  testing 
may  exceed  70  percent  of  the  software 
development  cost.54 

There  are  unlimited  possible  errors 
that  can  be  revealed  during  software 
testing.  Through  categorization,  the 
program  manager  may  construct  the 
test  effort  to  focus  on  those  appearing 
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to  be  most  applicable  to  his  project. 
Janusz  identified  12  classes  of  errors 
which  can  be  discovered  during  test¬ 
ing.  Among  these  are  logic,  overflow 
or  underflow  of  range,  timing,  data 
base,  incorrect  reporting,  and  specifi¬ 
cation  and  requirement  conflict. 

Dunn  and  Ullman  concur  with 
Janusz  regarding  the  ability  of  a  linear 
test  effort  to  uncover  all  possible  errors. 
One  method  of  conducting  a  software 
test  is  to  perform  output  analysis  for  a 
given  set  of  inputs.  However,  this  type 
of  "black-box"  testing  may  prove  to  be 
no  more  than  the  evaluation  of  a 
generation  of  a  statistically  insignificant 
number  of  possible  execution  states.55 
Yet,  reliability  testing  allows  the  soft¬ 
ware  tester  and  program  manager  the 
latitude  of  performing  sensitivity 
analysis  on  the  software  to  achieve  an 
acceptable  reliability  index. 

Real-Time  Systems.  Real-time  soft¬ 
ware  driven  systems  present  unique 
problems  to  the  software  test  effort. 
These  require  more  intensive  testing  to 
achieve  a  reliable  operational  status, 
and  are  more  difficult  to  satisfy  a  higher 
level  of  testing  standards,  according  to 
Deutsch.  He  quotes  Robert  V.  Head, 
and  identifies  attributes  of  real-time 
systems  which  complicate  the  testing  ef¬ 
fort.  They  are: 

—Magnitude  of  programming  effort  in 
terms  of  the  interconnection  of  program 
modules 

—Difficult  to  repeat  a  test  since  the  real¬ 
time  system  is  time  sequence  dependent 
—Multiprocessing  requires  that  equip¬ 
ment  interaction  be  precise 

—  Multiprogramming  causes  a  host  of 
problems  without  strict  control  of 
interfaces 

—  Inherent  logic  complexity 
—Random  access  storage  makes  it  dif¬ 
ficult  to  discover  and  isolate  problems. 

Due  to  the  nature  of  the  real-time 
system,  relative  complexities  in  the 
interface  of  hardware  and  software, 
and  ability  of  the  software  test  to 
discover  error,  testing  in  the  real-time 
environment  is  inherently  more  dif¬ 
ficult.  In  particular,  acceptance  testing 
of  real-time  programs  must  ensure  that 
the  software  possess  a  degree  of  reliabil¬ 
ity  far  exceeding  that  of  the  overall 
system.56  Identification  of  the  location 
of  the  fault  is  more  difficult  since  abil¬ 
ity  to  preserve  a  baseline  control 


scenario  is  almost  impossible.  Thus, 
analysis  of  real-time  system  software 
testing  becomes  much  more  input- 
output  dependent. 

Automated  Testing.  Current 
literature  suggests  one  method  of  pro¬ 
viding  higher  confidence  and  reliability 
in  software  testing  is  to  use  automatic 
test  generators  or  test  drivers.  These  are 
separate  programs  which  emulate  the 
system  test  bed.  Baker  states  that 
generating  a  method  of  clear,  cost- 
effective  test  methods  is  one  of  the  most 
technically  challenging  tasks  in  the  soft¬ 
ware  development.  In  view  of  this,  any 
effort  to  automate  and  create  repetitive 
tests  will  result  in  significant  relative 
cost  savings. 

Janusz  emphasizes  the  value  of 
automated  test  case  generators  in  that 
they  are  the  most  desired  objective  of 
the  methods  of  software  testing.  He 
believes  automated  testing  has  the  most 
promise,  and  will  provide  an  additional 
means  (including  normal,  current  prac¬ 
tice)  of  finding  errors  and  reducing  the 
effort  and  man-hours  required  for  soft¬ 
ware  testing. 

One  method  of  automating  the  test 
effort  is  through  test  drivers.  These  are 
software  programs  which  provide  data 
for  exercising  and  testing  software  that 
has  been  completed  or  is  under 
development.  An  example  is  a  test 
driver  which  passes  data  to  a  module 
under  test  and  receives  the  processed 
data  in  return,  performing  an  analysis 
on  the  expected  and  actual  results. 

Test  Management  and  Test 
Integration 

Perhaps  the  most  difficult  part  of 
managing  the  development  of  a  system 
is  the  planning  and  organizing  of  the 
test  effort.  Resources,  personnel, 
documentation,  and  funding  are  depen¬ 
dent  upon  the  identification  of  test  tasks 
and  an  integrated  schedule  to  support 
them.  The  program  manager  may  not, 
and  probably  cannot,  determine 
whether  the  contractor  is  integrating  the 
software  and  hardware  schedules  to 
conduct  conclusive,  system  integrated 
tests.  He  therefore  controls  the  program 
process  through  a  system  of  test  moni¬ 
toring  and  documentation  reviews  to 
determine  passage  from  one  test  phase 
to  the  next. 


The  first  step  is  to  establish  a  test  and 
development  environment  which  will 
ultimately  achieve  the  performance 
stated  in  the  requirements  document. 
Janusz,  quoting  from  DOD  5000.3, 
provides  four  points  strongly  related  to 
software  development  and  testing: 

—Stated  performance  objectives  for 
each  test  phase 

—Test  and  evaluation  will  be  used  to 
determine  whether  to  proceed  to  the 
next  phase 

—Realistic  testing  for  operational  use 
before  release  to  the  user 
—Operational  test  and  evaluation 
agencies  shall  participate  in  early  stages 
of  software  test  planning. 

To  digest  the  entire  test  and  evalua¬ 
tion  effort,  the  software  and,  eventu¬ 
ally,  the  system  must  be  broken  down 
into  manageable  pieces.  Deutsch  pro¬ 
poses  that  there  are  four  parts  of  the 
software  test  process:  test  planning,  test 
case  design,  test  execution,  and  evalua¬ 
tion  of  test  results.  Klucas  and  other 
authors  have  suggested  alternative 
classifications  in  dividing  software 
testing.  He  uses  the  separate  levels  of 
software  modules  as  phases  of  testing, 
beginning  with  unit  level  testing  and 
finishing  with  system  integration 
testing. 

One  goal  for  the  program  manager 
is  to  integrate  all  test  efforts  (within 
regulatory  and  test  agency  guidance)  in¬ 
to  an  efficient  and  non-duplicating  pro¬ 
duct.  At  the  inception  of  the  software 
test  process,  the  developing  contractor 
has  internal  tests  which  are  run  for 
verification  and  validation  of  require¬ 
ments.  At  the  end  of  this  software 
development,  a  complete  system  test  is 
conducted  on  hardware  and  the  soft¬ 
ware.  One  method  of  integrating  the 
tests  is  to  bring  test  agencies,  such  as 
the  Operational  Test  and  Evaluation 
Agency  (OTEA)  which  has  responsibil¬ 
ity  for  overall  systems  testing,  into  the 
test  process  earlier.  The  Continuous 
and  Comprehensive  Evaluation  Pro¬ 
gram  is  an  Army  Materiel  Command 
(AMC)  initiative  designed  to  integrate 
various  tests  and  test  agencies  into  the 
software  test  process.57 

A  primary  consideration  in  test  plan¬ 
ning  and  scheduling  is  the  degree  of 
testing  performed  on  the  software  pro¬ 
ject.  Hall  argues  one  of  the  major  pro¬ 
blems  in  software  testing  is  the  amount 
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of  software  which  is  actually  subject  to 
testing.  He  contends  only  about  one- 
third  of  all  program  statements  (code) 
are  exercised  in  the  test  process. 
Moreover,  continuing  to  run  the  soft¬ 
ware  test  may  only  fractionally  expand 
the  coverage  of  the  software  functions. 
Clear  requirements  analysis  and  test 
case  design  can,  and  will,  reduce  the 
amount  of  software  test  duplication  and 
conserve  time  and  material  resources  to 
cover  a  greater  percentage  of  the  actual 
code  and  path  testing. 

Test  Planning.  Software  test  manage¬ 
ment  requires  that  the  program 
manager  allocate  a  significant  part  of 
the  test  management  effort  to  test 
scheduling.  Formal  and  informal  means 
are  available  to  integrate  the  test  plan¬ 
ning  process.  The  principal  element 
from  which  to  base  the  test  schedule  is 
the  test  and  evaluation  master  plan 
(TEMP).55 

Frevvin  states  the  test  plan's  aim  is  to 
ensure  all  testing  activities,  including 
the  program  controlling  activity, 
understand  what  is  expected,  are 
manageable,  and  managed.  These  test 
plans  are  used  to  assist  in  the  pro¬ 
gram's  management  by  monitoring  the 
test  activities  of  the  project,  and 
scheduling  and  organizing  project 
resources  for  testing.  One  essential 
quality  of  the  test  plan  is  acting  as  a 
medium  for  communication  between 
the  developer  of  the  product,  product 
tester,  and  other  concerned  activities 
such  uo  u..d  evaluates ».  The 

test  plan  should  enable  all  testing  activ¬ 
ities  to  be  seen  in  the  context  of  the  full 
test  schedule,  rather  than  as  indepen¬ 
dent  actions. 

The  TEMP  defines  the  scope,  assess¬ 
ment  criteria,  evaluation  techniques, 
resources  and  schedule  of  the  testing  ac¬ 
tivities  of  a  project.  At  a  minimum, 
according  to  Frewin,  the  TEMP  should 
contain  these  items. 

—Test  items:  Identify  all  test  items  both 
as  defined  by  the  user,  or  as  developed 
during  the  test  process.  Identify  items 
excluded  ►•’p  test. 

—Functions  tested  and  those  not  tested. 
-Non-functional  testing:  Examines 
areas  like  stress  testing,  security  precau¬ 
tions,  and  access. 

—  Approach  to  testing:  Specifies  major 
activities,  techniques  and  tools  used  to 
test  each  group  of  functions  or  function 
combinations. 
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—Constraints  affecting  test  approach: 
Includes  time,  availability  of  items  to 
test,  resources,  and  personnel. 
—Pass/fail  criteria  for  items  under  test. 
—Test  deliverables:  Includes  test  plans, 
test  design  specifications,  test  reports, 
and  test  input  and  output  data. 
—Testing  responsibilities:  Who  is 
responsible  for  design  and  manage¬ 
ment,  providing  test  items,  and  pro¬ 
viding  environmental  needs  for  the 
tests. 

— Scheduling  of  testing  activities. 

— Contingency  plans:  What  to  do  in 
the  event  of  test  delays  or  failures. 


Test  Conduct.  Once  software  tests 
are  scheduled  and  resources  identified, 
the  actual  test  plan  and  test  cases  must 
be  addressed  and  refined.  Actual  con¬ 
duct  of  the  software  test  depends  on 
factors  such  as  complexity,  size,  new  or 
old  technology,  and  cost.  Tests  may  be 
technical,  such  as  reliability  measures 
using  deterministic  failure  rate  models; 
or  broad,  as  in  top  management  system 
configuration  audits. 


testing  of  lower-level  units  of  the  pro¬ 
gram  before  moving  into  higher-level 
testing.  This  requires  using  test  drivers. 
A  driver  exercises  the  software  compo¬ 
nent  by  simulating  the  activity  of  the 
next  higher  level  component.  Bottom- 
up  testing  requires  less  management 
emphasis  and  more  freedom  to  the  indi¬ 
vidual  analysts  and  programmers; 
however,  connectivity  and  integration 
may  suffer  as  a  result.  The  most  fre¬ 
quent  practice  of  software  testing  is  to 
combine  top-down  and  bottom-up 
strategies.  The  degree  that  one 
approach  is  used  over  the  other 
depends  on  the  nature  of  the  system; 
large  complex  systems  may  favor  top- 
down  testing  while  systems  which  rely 
on  large  modular  components  are 
suited  for  bottom-up  testing. 


Deutsch  explains  there  are  two 
choices  in  combining  software  com¬ 
ponents  for  testing:  phases  vs.  incre¬ 
mental,  and  top-down  vs.  bottom-up. 
The  phased  approach  allows  develop¬ 
ment  teams  to  produce  their  products 
independently  and  perform  integration 
and  module  interfaces  later.  The  phases 
approach  has  the  advantage  of 
developmental  speed,  but  the  incre¬ 
mental  approach  is  the  one  required  by 
the  Department  of  Defense.  The  incre¬ 
mental  approach  is  done  in  the  follow¬ 
ing  steps: 

—Design,  code,  and  test  one  module  by 
itself 

— Add  another  module 
— Test  and  debug  the  combination 
—  Repeat  steps  two  and  three  until  the 
entire  software  package  has  been  tested. 
Top-down  testing  begins  at  the  top 
of  the  software  structure  and  proceeds 
to  test  components  at  progressively 
lower  levels.  This  method  requires 
using  test  stubs  (statements  which  make 
the  program  act  as  if  it  is  accessing  an 
actual  block  of  code),  according  to 
Deutsch.  Top-down  testing  is  especially 
valuable  in  keeping  the  software 
development  keyed  to  the  overall 
requirements  and  preventing  software 
modules  to  be  written  without  clear 
objectives.  Bottom-up  testing  is  the 


A  pervasive  decision  in  the  test  effort 
is  the  length,  extent  and  degree  of 
testing.  As  stated,  regardless  of  the 
scope  and  depth,  no  amount  of  testing 
can  completely  discover  all  possible 
process  and  path  errors.  This  conflict 
between  complete  confidence  in  the 
software  product  and  the  ability  to  test 
to  a  given  level  of  confidence  has  led 
to  a  field  of  software  testing  known  as 
stress  testing.  The  concept  of  total  unit 
testing  and  integration  for  any  type  of 
input  data  is  essentially  stress  testing. 
Hall  enumerates  the  following  charac¬ 
teristics  which  typify  the  conduct  of 
stress  testing: 


— Trying  to  pass  more  information 
than  the  processor  is  designed  to 
accommodate 

— Excessive  data  transfer  requirements 
— Exceeding  assigned  storage  area 
requirements 

—  Defining  failure  as  any  stop  of  the 
test  prior  to  specified  completion  time. 


Dunn  and  Ullman  do  not  support 
the  contention  that  stress  testing  is  an 
unfair  test  of  the  software's  ability.  Fre¬ 
quently,  stress  testing  results  in  a 
"breaking  point"  well  below  one's 
expectations.  However,  stress  testing 
is  representative  of  the  operational 
environment,  and  should  be  done  if 
possible.  This  type  of  testing  may  be 
compared  to  destructive  testing  in 
hardware  items. 


Stress  testing  should  not  be  used  in 
lieu  of  requirements  testing.  When 
defining  test  cases,  the  program 
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manager  must  require  standards  and 
criteria  even  for  stress  testing.  This  will 
minimize  conflicts  between  confor¬ 
mance  to  contractual  specifications 
and  test  results. 

Test  Outputs.  As  a  result  of  the 
testing  process,  certain  results  should 
be  available  to  the  program  manager. 
Richardson  and  Clarke  remark  that 
although  verification  proves  or 
disproves  the  correctness  of  the  code, 
program  testing  is  necessary  to  assess 
quality  of  software.  Outputs  of  testing 
include  factors  like  run-time  behavior, 
interfacing  between  modules,  and  data 
transfer.59  Products  resulting  from  the 
test  effort  are  based  on  contract 
specifications.  From  a  program 
manager's  perspective,  the  contractor 
can  only  be  accountable  for  the  com¬ 
pliance  of  the  test  effort  to  the  contract 
specification.60 

Results  of  test  efforts  are  only 
relative  in  terms  of  confidence  in  the 
software.  The  test  manager  must 
assume  correct  requirements  and 
specifications.  Although  he  cannot 
guarantee  absolute  correctness  of  soft¬ 
ware,  test  results  indicate  a  high  prob¬ 
ability  of  compliance  to  test  criteria. 
Similarly,  Dunn  and  Ullman  agree 
with  this  position,  in  that  proofs  and 
tests  are  alike  since  neither  can 
eliminate  the  possibility  of  potential 
failures. 

Cost  Considerations.  Various  soft¬ 
ware  cost  estimating  techniques  may 
be  used  to  predict  or  evaluate  cost  of 
software  development.  One  of  these 
models  is  the  Constructive  COst 
MOdel  (COCOMO)  developed  by 
Boehm  as  a  parametric  method  of 
estimating  software  costs  based  on 
programming  code.  Several  variations 
of  the  COCOMO  are  used  throughout 
the  Army  Materiel  Command.  The 
basis  for  cost  estimating  is  lines  of  pro¬ 
gramming  code.  The  estimated  size  of 
the  project  is  then  converted  into  man- 
months  (152  hours  per  month)  and 
expressed  in  terms  of  dollars. 

The  COCOMO  model  is  intended 
for  small-to-medium-size  projects,  and 
has  three  levels  of  detail:  basic,  inter¬ 
mediate,  and  detailed.  The  COCOMO 
provides  three  levels  or  levels  of 
analysis.  The  basic  model  is  used  for 
in-house  software  development  and  is 
good  for  an  initial  order  of  magnitude 
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of  software  costs.  The  intermediate 
model  uses  the  basic  model  and 
includes  factors  like  hardware,  person¬ 
nel  quality  and  experience,  and  tools. 
The  detailed  model  applies  the  two 
lower  level  models  for  specific  projects. 

Other  parametric  software  cost 
models  have  been  developed  including: 
Software  Life  Cycle  Model  (SLIM), 
FAST-E,  System-3,  and  Price-S.  The 
Price-S  model  (RCA)  was  developed  in 
1977  as  the  first  complex  and  commer¬ 
cially  available  model  for  software  cost 
estimating.  Unlike  COCOMO,  the 
actual  algorithms  of  estimating  costs 
are  not  available  due  to  proprietary 
rights.  The  Price-S  model  provides  cost 
estimates  for  developmental  soft¬ 
ware.61  The  actual  software  cost 
estimating  model  used  for  program 
costing  is  more  than  likely  determined 
by  command  guidance  with  the  objec¬ 
tive  being  a  standard  cost  estimating 
technique  used  within  the  organization. 


ithin  the 
U.S.  Army 
Conimunications- 
Electronics  Command, 
two  directorates  provide 
valuable  software 
and  evaluation 

assistance  .  .  . 
_ 

Solutions  and  Recommendations 

Within  the  U.S.  Army  Communica- 
tions-Electronics  Command  (CECOM), 
two  directorates  provide  valuable  soft¬ 
ware  test  and  evaluation  assistance  to 
program  managers.  The  Center  for  Life 
Cycle  Software  Engineering  (CLCSE) 
conducts  software  development  mon¬ 
itoring  and  sustainment  evaluation. 
The  Product  Assurance  and  Test  Direc¬ 
torate  (PA&T)  fulfills  the  role  of  inde¬ 
pendent  testing  office  (ITO)  and  coor¬ 
dinates  and  approves  the  IV&V  test¬ 
ing.  Together,  these  two  agencies  pro¬ 
vide  comprehensive  software  test  and 
evaluation  support  of  C-E  and  other 
program  offices  located  at  Fort 
Monmouth,  N.  !. 


Based  on  my  research  conducted  at 
CECOM,  and  a  review  of  the  current 
software  testing  literature,  software 
development,  and  program  manage¬ 
ment,  six  areas  were  identified  to  pro¬ 
vide  a  central  theme  in  software  testing 
management.  While  not  intended  to  be 
exhaustive,  they  are  sufficient  to  keep 
a  program  on  track  and  in  balance 
throughout  its  development.  A  short 
summary  of  each  topic  follows. 

Test  Planning.  This  begins  with  an 
estimate  of  the  size  and  extent  of  the 
software  development  effort.  Using 
this  as  a  basis,  this  step  entails  iden¬ 
tification  of  required  test  agencies, 
published  guidance,  test  cases,  use  of 
IV&V  contractors,  and  the  Test  and 
Evaluation  Master  Plan. 

Test  Funding.  This  is  important  to 
address  since  this  category  becomes 
more  critical  as  software  changes  and 
intial  esti^atpc  are  revised.  Depending 
on  cost  and  volume  of  the  acquisition, 
software  tests  may  account  for  one- 
fourth  of  total  procurement  costs.  The 
method  and  basis  of  determining  the 
test  cost  estimate,  required  hardware, 
development  of  test  drivers  and  stubs, 
and  validation  of  test  results  are  con¬ 
siderations  when  examining  test 
funding. 

Test  Scheduling.  This  is  best  done 
from  a  backward  planning  perspective. 
Most  programs  are  hardware  schedule 
dependent  until  system  or  software 
integration  testing.  Critical  areas  in 
scheduling  are  test  integration  with 
hardware,  agency  coordination, 
sequencing  lower-to-higher-level  tests, 
and  critical  design  reviews. 

Test  Conduct.  This  is  usually  an 
iterative  process  which  begins  with 
informal  unit  and  module  tests  and 
progresses  toward  formal  system  and 
integration  testing.  Ground  rules  must 
be  in  place  before  even  these  informal 
tests  occur  since  one  of  the  test  objec¬ 
tives  must  be  to  reduce  testing  duplica¬ 
tion.  Roles  of  developing  contractor, 
integrating  contractor,  test  agencies, 
and  IV&V  testers  need  to  be  specified. 

Test  Control.  This  is  primarily  con¬ 
cerned  with  the  criteria  and  activities 
responsible  for  approval  of  the  soft¬ 
ware  to  move  from  one  phase  of 
testing  to  the  next.  Principal 
documents  for  this  area  are  the  TEMP 
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and  software  quality  evaluation  plan. 
One  kev  issue  is  how  to  resolve  dis¬ 
putes  between  test  participants  such  as 
the  integrating  contractor  and  IV&V 
tester.  Format  and  schedule  of  test 
reports  will  contribute  to  software  test 
control. 

Test  Improvements.  These  consist  of 
the  review  and  evaluation  of  the  test 
effort.  Where  are  there  inefficiencies, 
poor  coordination  and  cooperation, 
duplication,  unnecessary  reporting, 
and  excess  cost  and  schedule  con¬ 
straints? 

The  following  checklist  is  a  compila¬ 
tion  based  on  research  done  to  support 
this  paper.  The  format  comprises  self¬ 
check  u uestions  which  address  each  of 
the  six  aspects  described.  As  a 
minimum,  they  represent  topics  which 
should  be  considered  and  evaluated. 

Software  Project  Management 
Testing  Checklist 

All  questions  should  be  answered  in 
the  affirmative  except  where  a  specific 
response  is  required. 

General  Questions 

1.  What  percentage  of  this  project 
is  software  oriented? 

2.  What  guidance  is  available  for 
managing  the  software  test  portion  of 
this  project? 

3.  Is  the  software  for  this  project 
primarily  new  or  old  technology? 

4.  How  can  the  extent  and  dura¬ 
tion  of  the  test  be  estimated? 

Software  Test  Planning 

1 .  Is  the  test  and  evaluation  master 
plan  (TEMP)  coordinated  with  all  the 
applicable  test  activities? 

2.  Does  the  test  plan  present  a 
complete  picture  of  all  aspects  of  the 
test  effort? 

3.  Does  the  TEMP  address  soft¬ 
ware  testing  as  a  separate  portion  of 
the  project? 

4  Does  the  independent  testing 
office  i PTO i  draft  or  assist  in  the 
drafting  of  the  test  procedures? 

5,  Is  integration  testing  done  as  a 
separate  effort  from  that  done  by  the 
developing  contractor? 

6.  Is  the  emphasis  of  the  software 
testing  and  evaluation  on  initial 
design? 
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7.  Are  contingency  plans  addressed 
in  the  event  of  test  failure? 

Software  Test  Scheduling 

1.  Is  hardware  and  software  inte¬ 
grated  into  the  overall  test  schedule? 

2.  Is  preliminary  testing  done  as 
the  basis  for  the  next  phase  of  testing? 

3.  Have  requirements  determina¬ 
tion  (test  procedures)  been  identified 
before  incremental  testing? 

4.  Has  incremental  testing  been 
completed  prior  to  environmental 
testing? 

5.  Has  validation  testing  been 
completed  before  operational  testing? 

6.  Has  validation  testing  been 
done  progressively? 

7.  Are  there  sufficient  resources  to 
conduct  independent  verification  and 
validation  (IV&V)  testing? 

Software  Test  Conduct 

1.  Is  this  software  tested  by  inte¬ 
gration  of  modules? 

2.  Does  the  integration  testing 
evaluate  previous  test  results? 

3.  Does  the  integration  testing  use 
the  test  specifications  and  requirements? 

4.  Is  the  test  conducted  using  a 
combined  Top-down  and  Bottom-up 
approach? 

5 .  Does  the  independent  testing  of¬ 
fice  (ITO)  develop: 

a.  Guidance  on  the  conduct  of 
the  test? 

b.  Feedback  on  problem 
reporting? 

c.  Comprehensive  test  reports? 

6.  Is  a  specific  set  of  standards  or 
guidance  used  to  conduct  IV&V 
testing? 

7.  Is  a  separate  IV&V  contractor 
used  for  large,  complex  systems? 

8.  Are  test  metrics  and  test 
generators  used  to  evaluate  the  soft¬ 
ware  as  much  as  possible? 

9.  To  what  degree  is  stress  testing 
used  to  evaluate  performance  bound¬ 
aries? 

Software  Test  Control 

1 .  Does  the  PM  office  have  visibil¬ 
ity  into  the  software  development 
testing  process? 

2.  Does  IV&V  testing  begin  at  the 
conclusion  of  integration  testing? 

3.  Are  independent  tests  based  on 
results  of  earlier  tests  (minimum 
duplication)? 

67 


4.  Is  the  acceptance  and  qualifica¬ 
tion  t^t  done  by  a  separate  agency 
than  the  developing  contractor? 

5.  What  are  the  software  quality 
and  quality  design  specifications  or 
guidance  being  used? 

6.  Is  the  ITO  used  to  conduct 
IV&V  testing? 

7.  Is  the  software  testing  evaluated 
using: 

a.  Automatic  test  case 
generators? 

b.  Design  walk-throughs? 

c.  Reliability  models? 

8.  Are  test  cases  developed  outside 
of  the  developing  contractor's  interest? 

9.  Is  there  an  adversarial  relation¬ 
ship  between  the  developing  contrac¬ 
tor  and  the  test  agency? 

10.  Are  test  resource  and  cost 
estimations  reasonable? 

Conclusion 

Software  test  management  depends 
upon  a  thorough  examination  of  the 
software  project's  requirements,  scope, 
and  complexity.  From  this,  the  pro¬ 
gram  manager  develops  test  cases 
representative  of  the  technical  and 
operational  environment.  A  strong 
effort  to  integrate  software  and  hard¬ 
ware  program  schedules  will  provide 
success  at  a  future  date  when  system 
integration  and  acceptance  testing  are 
conducted.  A  well-coordinated  and 
detailed  test  and  evaluation  plan  will 
reduce  test  duplication,  resources, 
schedule  conflicts,  and  eventually  con¬ 
serve  funds. 

Software  intensive  weapon  systems 
require  extensive  and  thorough  testing 
to  build  and  sustain  user  confidence. 
The  program  manager  can  signifi¬ 
cantly  raise  this  level  of  confidence 
through  well-planned  and  decisive 
software  test  management. 

Besides  the  DOD  STDs  2167  and 
2168  (Draft),  these  are  three  excellent 
desktop  references  for  the  program 
manager  on  software  testing: 

— Software  Testing  and  Evaluation, 
DeMillo  et  al,  1987. 

—  Managing  a  Programming  Project, 
Metzger,  1981- 

— Software  Verification  and  Valida¬ 
tion,  Deutsch,  1982. 
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he  Department  of 
Defense  (DOD)  has 
developed  a  variety  of  man¬ 
agement  systems  designed  to 
control,  in  varying  degrees, 
the  critical  parameters  of 
weapons  systems  as  they 
progress  through  the  stages 
of  the  acquisition  process. 

The  critical  parameters  of  a 
major  program  include  cost, 
schedule,  and  performance. 

What  will  it  cost  the  govern¬ 
ment  to  acquire  the  system; 
how  long  will  it  take  to  research,  develop,  procure,  deliver, 
and  field  it:  when  are  the  critical  events  of  the  acquisition 
process — major  milestone  decisions,  developmental  and 
operational  testing,  contract  awards — scheduled  to  occur? 
What  are  the  planned  technical  and  operational  character¬ 
istics  of  the  system;  how  will  they  relate  to  the  overall  ef¬ 
fectiveness  once  it  is  deployed;  what  are  the  operating  sup¬ 
port  implications  and  are  they  being  adequately  planned  for? 
Finally,  how  effectively  will  the  system  perform  its  intended 
mission?  These  are  examples  of  questions  to  which  the  above 
parameters  are  addressed.  The  ability  to  answer  these  ques¬ 
tions  satisfactorily  enables  DOD  managers  to  work  more 
effectively. 

Major  program  baselining  is  a  management  technique 
designed  to  enhance  program  stability  by  adding  a  measure 
of  control  over  critical  program  parameters.  Baselining  as 
a  concept  and  practice  is  certainly  not  new,  but  it  has 
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generated  an  enormous 
amount  of  interest  recently 
at  the  Pentagon  and  on 
Capitol  Hill.  This  increased 
attention  is  due  to  a  number 
of  factors.  The  current  fiscal 
environment,  for  example,  is 
one  of  severe  constraint, 
dramatically  highlighted  by 
the  recent  resurrection  of  the 
Gramm-Rudman-Hollings 
deficit-reduction  legislation. 
(As  of  this  writing,  congres¬ 
sional  and  administration 
negotiators  have  agreed  to  reduce  the  federal  deficit  by  more 
than  $76  billion  for  fiscal  years  1988  and  1989.  It  is  unclear 
exactly  what  the  ramifications  of  this  agreement  will  be  for 
defense  budget  authority  and  outlays;  the  FY  89  program 
is  currently  being  revised.)  The  public  and  congressional 
consensus  for  higher  defense  spending,  evident  a  few  years 
ago,  has  eroded  alarmingly.  Finally,  procurement 
brouhahas,  ranging  from  overpriced  spare  parts  to  unfore¬ 
seen  and  costly  problems  with  avionics  on  platforms,  con¬ 
tributed  to  a  general  focus  of  attention  on  the  DOD  acquisi¬ 
tion  system.  In  light  of  these  sobering  trends,  baselining  of 
major  defense  acquisition  programs  will  continue  to  repre¬ 
sent  a  legitimate  means  of  bringing  much-needed  stability 
to  the  process  and  illuminating  affordability  issues. 

The  appointment  of  Frank  Carlucci  as  Secretary  of 
Defense  rekindled  interest  in  enhancing  program  stability. 
While  Deputy  Secretary  of  Defense  in  1981,  Mr.  Carlucci 
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articulated  a  set  ot  management  prin¬ 
ciples  and  actions  designed  to  increase 
the  integrity  of  the  acquisition  process. 
Many  of  these  principles  came  to  be 
known  as  the  Carlucci  Initiatives,” 
centered  around  improving  program 
stability.  In  fact,  one  of  the  initiatives 
was  actually  entitled  Program  Stabili¬ 
ty,  but  the  initiatives  Realistic 
Budgeting.  Economic  Production 
Rates,  and  Multiyear  Procurement 
were  all  related  to  the  concept  of  pro¬ 
gram  stability  as  well.  Baselining,  as 
we  know  it,  comes  from  the  Carlucci 
reforms.  Mr.  Carlucci,  in  his  Senate 
confirmation  hearings,  contended  that 
a  slimmer,  more  efficient  military  will 
be  paramount  in  the  face  of  fiscal  con¬ 
straint  and  that  many  tough  decisions 
will  have  to  be  made,  presumably  on 
whether  or  not  to  terminate  certain 
programs. 1 

Why  should  w’e  be  concerned  about 
enhancing  program  stability?  Program 
instability  damages  the  integrity  of  the 
systems  acquisition  process.  Destabi¬ 
lization  of  programs  occurs  for  a 
number  of  reasons,  many  beyond  the 
control  of  any  one  official,  no  matter 
the  level,  and  certainly  beyond  the 
control  of  the  program  manager.  Some 
destabilizing  factors  include  fiscal  con¬ 
straint  and  attendant  fluctuations  in 
defense  budget  authority  levels; 
changes  in  program  structure  or  pro¬ 
curement  profile  due  to  technical  or 
contractual  factors;  and  overburden¬ 
ing  of  resource  levels  due  to  too  many 
programs  in  the  acquisition  cycle 
simultaneously.  Negative  ramifications 
of  program  instability,  among  other 
things,  include: 

—  Fostering  defense  industry  unwill¬ 
ingness  to  make  productivity¬ 
improving  capital  investments 

—  Increases  in  unit  costs  of  defense 
systems 

Layoffs  in  the  defense  industry  due 
to  program  delays 

Disincentive  tor  firms  (contractors, 
subcontractors,  suppliers,  and  ven¬ 
dors  i  to  remain  in  the  defense 
busin-  ss. : 

(liven  the  problems  associated  with 
program  instability,  baselining  should 
be  considered  a  technique  to  reduce 
destabilizing  and  improve  manage¬ 
ment  effectiveness. 
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This  article  should  give  a  com¬ 
prehensive  understanding  of  the  con¬ 
cept.  history,  and  current  practice  of 
baselining  and  will  draw  some  conclu¬ 
sions  on  baselining  effectiveness.  I  will 
examine  the  background  and  purpose 
of  baselining,  with  the  military  service 
efforts  primarily;  discuss  baselining 
history,  roughly  since  early  1986;  and 
assess  the  executive  and  legislative  in¬ 
itiatives  implemented  during  that  time. 
1  will  then  discuss  the  current  status  of 
DOD  baselining  policy  and  implemen¬ 
tation,  examining  successes  of  policy 
implementation  and  assessing  prob¬ 
lems  encountered.  Finally,  several  con¬ 
clusions  will  be  drawn  on  the  future  of 
major  program  baselining  and  its  po¬ 
tential  for  enhancing  program 
stability. 

Baselining:  Purpose  and  Definition 

For  this  article,  I  define  baselining  as 
a  formal  agreement  between  essential 
program  participants  that  specifies  the 
critical  parameters  of  a  program  enter¬ 
ing  full-scale  development  or  produc¬ 
tion,  to  include  cost,  schedule,  and 
performance.  Baselining  is  a  technique 
used  to  enhance  stability  and  control 
cost  growth.  Once  the  baseline  is  ap¬ 
proved,  the  program  manager  has  au¬ 
thority  to  manage  the  program  within 
the  specified  baseline  parameters. 

Essential  program  participants  for  a 
DOD-level  baseline  agreement  are  the 
program  manager  (PM),  the  program 
executive  officer  (PEO),  the  military 
service  acquisition  executive  (SAE), 
and  the  defense  acquisition  executive 
(DAE). 

The  PM  is  the  officer  chartered  to 
manage  a  major  defense  acquisition 
program  and  reports  directly  to  the 

PEO. 

The  PEO  is  the  officer  in  each  mili¬ 
tary  service  reporting  directly  to  the 
SAE  and  responsible  for  a  defined 
number  of  major  defense  acquisition 
programs  (often  the  programs  under 
the  PEO’s  purview  are  related  func¬ 
tionally,  such  as  command,  control, 
and  communications  (CM  programs 
or  tactical  aircraft  programs). 

The  SAE  is  the  senior  acquisition  ex¬ 
ecutive  within  each  military  depart¬ 
ment,  designated  by  the  component 
head,  responsible  for  administering  ac¬ 


quisition  programs  in  accordance  with 
DOD  policies  and  guidelines.3 

Baselining:  Military  Service 
Experience 

Air  Force.  No  discussion  of  base¬ 
lining  policy  is  complete  without  ex¬ 
amining  the  Air  Force  experience.  The 
Air  Force  baselining  system  has  been 
institutionalized  since  1983,  and  has 
served  as  the  framework  upon  which 
most  subsequent  baselining  efforts 
have  been  constructed. 

Air  Force  policy  on  acquisition  pro¬ 
gram  baselining  is  officially  embodied 
in  Air  Force  Regulation  800-25 
(AFR  800-25),  Acquisition  Program 
Baselining A  The  Air  Force  initiated 
major  program  baselining  to  enhance 
program  stability  and  control  cost 
growth  for  selected  acquisition  pro¬ 
grams.  During  the  late  1970s,  the  Air 
Force  Systems  Command  (AFSC)  in¬ 
itiated  the  concept  of  baselining  as  a 
sort  of  cost  "contract"  between  the  PM 
and  the  commander.5  This  relatively 
narrow  document  was  expanded  in  the 
early  1980s  into  a  full-fledged  "agree¬ 
ment"  involving  all  program  par¬ 
ticipants,  such  as  AFSC,  Air  Force 
Logistics  Command  (AFLC),  Air  Force 
Operational  Test  and  Evaluation 
(AFOTEC),  and  Military  Airlift  Com¬ 
mand  (MAC).  By  1984,  this  baselining 
approach  had  evolved  into  a  fully  in¬ 
stitutionalized  policy  as  AFR  800-25 
was  published  for  the  first  time. 

The  current  AFR  800-25,  published 
April  1986  and  currently  being  revised 
to  reflect  recent  changes  in  DOD  ac¬ 
quisition  policy,  details  the  purpose  of 
program  baselining  in  the  Air  Force 
and  the  procedures  necessary  to  ac¬ 
complish  baselining.  According  to 
AFR  800-25,  "Acquisition  program 
baselining  is  a  management  technique 
used  to  enhance  stability  and  contrc  1 
cost  growth  for  selected  Air  Force 
weapon  and  information  systems  ac¬ 
quisition  programs.”1’  Two  concepts, 
program  stability  and  selected  pro¬ 
grams,  stand  out.  By  stating  the  pur¬ 
pose  in  program  stability,  the  Air 
Force  implies  that  baselining  does  not 
merely  represent  a  program-reporting 
mechanism,  but  that  it  is  a  "contract' 
between  program  participants  in  an  at¬ 
tempt  to  adhere  to  a  specified  program 
content.  The  Air  Force  did  not  initial¬ 
ly  intend  baselining  tor  all  acquisition 
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programs  but,  rather,  tor  a  selected 
few.  This  is  an  important  distinction, 
especially  in  light  of  recent  policy  and 
legislation. 
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tion,  location,  contractor  role,  and  ac¬ 
ceptance  testing;  and,  finally, 
11)  Schedule  including  key  dates  and 
milestones. 


Who  selects  acquisition  programs 
tor  baselining  at  the  Headquarters  level 
within  the  Air  Force  (HQ  USAF)?  Ac¬ 
cording  to  AFR  800-25,  this  decision  is 
arrived  at  consensually  through  the 
recommendations  of  several  staff  com¬ 
ponents —  the  Assistant  Secretary  of 
the  Air  Force  for  Acquisition 
tSAF  A Q);  Offices  of  Primary 
Responsibility  (HQ  USAF/OPR), 
presumably  program  offices;  Direc¬ 
torate  of  Program  Planning  and  In¬ 
tegration  ( SAF  AQX)  and  others.  The 
Vice  Chief  of  Staff  (CV)  approves  cer¬ 
tain  baselines  and  his  deputy,  the  SAE, 
approves  certain  baselines,  depending 
upon  the  nature  of  the  program;  i.e.. 
Air  Force  priority,  funding  level,  etc. 
When  a  program  baseline  is  estab¬ 
lished,  the  CV  informs  the  Secretary  of 
the  Air  Force  (SAF). 


Also,  the  Air  Force  baseline  includes 
a  section  on  tunding.  Funding  informa¬ 
tion  is  divided  into  Total  Program 
Funding,  Program  Acquisition  Fund¬ 
ing,  and  Program  Support  Funding, 
and  includes  all  appropriated  fund:, 
budget  year  funding,  Five  Year 
Defense  Plan  (FYDP)  funding  and  a  To 
Complete  column.  Funding  is  given  in 
Base-Year  and  Then-Year  dollars.7 


The  AFR  800-25  requires  a  relative¬ 
ly  large  amount  of  program  informa¬ 
tion  and  precise  level  of  detail  to  be  in¬ 
cluded  in  the  program  baseline.  The 
Program  Content  section  of  the  base¬ 
line  document,  for  example,  is  divided 
into  categories;  1)  System  Definition 
including  configuration,  government- 
furnished  equipment  (GFE),  and  sub¬ 
systems;  2)  Performance  including 
operating  characteristics,  reliability, 
availability,  key  specifications  (mili¬ 
tary,  federal,  etc.),  and  quality  stan¬ 
dards:  3)  Operations  Concept  in¬ 
cluding  basing  concept,  primary  use, 
and  initial  operating  capability  (IOCs); 
4)  System  Readiness  including 
readiness  objectives,  production  surge, 
and  mobility;  5)  Integrated  Logistics 
Support  including  initial  spares, 
replenishment  spares,  and  technical 
data;  6)  Maintenance  Concept  in¬ 
cluding  deployability  and  depot  main¬ 
tenance:  7)  Communications.  Data 
Automation,  and  Information  Systems 
Resources  including  equipment  type, 
locations  and  network  standards;  8) 
Test  and  Evaluation  including  test 
schedule  milestones,  locations,  con¬ 
tractor  role,  and  unusual  types  of 
testing:  9)  Training  including  re¬ 
quirements,  types,  milestones,  and 
simulators:  lOi  Facilities  (engineering 
and  installation)  including  construc- 


Another  section  of  the  Air  Force 
baseline  involves  deferred  program 
content.  This  section  details  program 
elements  of  an  approved  baseline 
which  the  program  participants  agree 
must  be  removed  from  the  baseline 
because  of  fiscal  constraints.  These 
elements  are  then  reinserted  into  the 
Planning,  Programming,  and  Budget¬ 
ing  System  (PPBS)  to  compete  for 
resources.  This  deferral  mechanism 
highlights  a  central  feature  of  the  Air 
Force  baselining  system,  the  executable 
and  non-executable  baseline.  In  an  ex¬ 
ecutable  baseline,  the  level  of  approved 
funding  is  sufficient  to  accomplish  the 
program  content;  in  a  non-executable 
baseline,  the  level  of  funding  is  insuf¬ 
ficient  (or  one  of  the  program  partici¬ 
pants  cannot  support/accomplish  the 
program  content).  By  making  such  a 
distinction,  the  baselining  process 
gains  integrity  and  alerts  Air  Force 
leadership  to  potential  affordability 
and/or  technical  problems. 


Chief  of  Naval  Operations  (OPNAV) 
initiated  the  Program  Management 
Proposal  (PMP)  system  as  an  effort  to 
"regulate  research  and  development 
and  control  configuration  changes  and 
modifications  to  ships,  aircraft,  mis¬ 
siles,  systems,  combat  vehicles...."9 
Part  of  the  Navy's  explicit  intent  in 
establishing  the  PMP  process  was  to 
"...avoid  Research  and  Development 
programs  that  lead  nowhere...."  and 
"...balancing  the  need  for  new  pro¬ 
grams  with  modernizing  existing 
equipments....''10  it  seems  that  en¬ 
hancing  program  stability  was  the 
primary  impetus  in  the  Navy's  move 
to  implement  baselining. 


Technically,  the  PMP  process  is  not 
the  initial  baselining  effort  within  the 
Navy  but  represents  the  mechanism  by 
which  the  Navy  approves  and  pro¬ 
cesses  changes  to  baselines.  The  Navy 
process  of  establishing  baselines  is  the 
product  of  consensual  staff  negotiation 
as  in  the  Air  Force,  and  is  ratified  at 
the  highest  level.  The  Chief  of  Naval 
Operations  (CNO)  and  the  Comman¬ 
dant  of  the  Marine  Corps  (CMC) 
establish  baselines.  The  Navy  base¬ 
lining  system  recognizes  the  attendant 
fluctuations  in  a  program  as  it  pro¬ 
gresses  through  major  acquisition 
milestones  and,  consequently,  base¬ 
lines  programs  in  this  fashion.  This 
philosophy  is  similar  to  the  Air  Force 
system,  which  baselines  in  a  total  pro¬ 
gram  sense.  Navy  baselines  are  up¬ 
dated  many  times  during  the  acquisi¬ 
tion  cycle. 


The  Air  Force  baseline  then  is  much 
more  than  merely  "...a  brief  baseline 
agreement  describing  functional  speci¬ 
fications,  cost,  schedule  and  other  fac¬ 
tors  critical  to  the  program’s  success" 
that  David  Packard  envisioned  for 
DOD-wide  implementation.8  The  Air 
Force  baseline  is  not  brief  and  does  not 
simply  extract  those  program  '"critical" 
factors;  rather,  the  baseline  is  a  de¬ 
tailed  portrait  of  the  acquisition  pro¬ 
gram,  focusing  on  everything  from  the 
actual  program  definition  to  its  man¬ 
ning  and  training  requirements. 
Depending  on  the  nature  of  the  pro¬ 
gram,  the  baseline  may  include  the  sig¬ 
nature  of  as  many  as  nine  officials, 
from  the  PM  to  the  Secretary  of  the 
Air  Force. 


Navy.  In  1982,  the  Office  of  the 


For  example,  in  RDT&E,  when  an 
Operational  Requirement  (OR)  has 
been  approved,  the  OR  becomes  the 
baseline.  Subsequently,  the  baseline  is 
updated  at  each  approved  milestone. 
The  Navy  baselining  system  then 
begins  earlier  in  the  acquisition  cycle 
than  the  Air  Force  Milestone  II  system 
(Full-Scale  Development  (FSD)).  The 
baseline  is  required  to  define  program 
scope,  definition  cost,  and  configura¬ 
tion.  In  a  sense,  the  Navy's  baseline 
document  is  not  a  document,  but, 
rather,  is  embodied  in  decisional-  and 
planning-related  documentation.  Prior 
to  Milestone  II,  the  OR  serves  as  the 
baseline.  At  a  major  program's  ap¬ 
proval  point  for  FSD,  for  example, 
there  are  many  forms  of  documenta¬ 
tion,  in  the  Navy  and  the  Department 
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of  Defense,  describing  certain  facets  of 
the  program;  in  aggregate,  these 
documents  represent  a  detailed  pro¬ 
gram  description.  The  primary 
baseline  documentation  is  the  Decision 
Coordinating  Paper  (DCP),  the  DOD- 
level  decisional  report  summarizing 
program  accomplishments  to  date  and 
describing  the  cost,  schedule,  perfor¬ 
mance,  readiness  and  supportability 
parameters  of  the  program. 

Specifically,  revised  Navy  guid¬ 
ance11  now  defines  an  approved 
baseline  as:  "The  combination  of  ap¬ 
proved  program  schedule,  configura¬ 
tion,  performance  characteristics,  ac¬ 
quisition  strategy,  and  other  business 
aspects  which  constitute  the  variables 
reflected  in  either  the  appropriate  ac¬ 
quisition  milestone  approval  for  the 
acquisition  category  or  as  reflected  in 
the  latest  approved  program  manage¬ 
ment  proposal  (PMP)  action." 

Changes  to  the  baseline  as  a  result 
of  the  PPBS  process  do  not  require 
submittal  of  a  PMP;  only  changes  oc¬ 
curring  outside  the  normal  resource 
allocation  process  trigger  PMPs.  This 
is  an  interesting  deviation  criterion  and 
actually  mirrors  a  recent  policy  enun- 
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ciation  at  the  Department  of  Defense 
level  in  DoD  Directive  5000.1  regard¬ 
ing  baselining  changes  and  the  PPBS 
process.  The  PMPs  are  initiated  by  the 
program  manager,  systems  com¬ 
mander,  or  the  resource  sponsor  and 
are  processed  in  the  event  of  approval 
of  an  OR  for  system  improvement  or 
an  anticipated  baseline  change  which 
will  result  in  recurring,  non-recurring, 
or  support  costs.  No  dollar  threshold 
values  are  entertained;  any  change 
(read,  increase)  in  cost  requires  a  PMP. 


Packard  Commission  and  to  reflect 
changes  in  Department  of  Defense 
policy,  reorganization  and  legislative 
mandates.  First,  we  will  review  brief¬ 
ly  the  PMCS  model,  much  of  which  re¬ 
mains  similar  in  scope  after  recent 


revisions. 


The  PMP  process  elevates  proposed 
changes  in  approved  programs  to  the 
Navy  leadership  for  approval  or  disap¬ 
proval.  By  elevating  this  decision,  the 
purpose  of  the  PMP  system  "...is  to 
prevent  cost  growth  and  requirements 
creep  due  to  existing  systems  or  mak¬ 
ing  improvements  that  entail  'hidden' 
execution  costs."12 


Army.  Since  1981,  the  Army  has 
controlled  cost  and  managed  programs 
through  the  Program  Management 
Control  System  (PMCS).  Recently,  the 
Army  revised  its  baselining  procedures 
to  accommodate  the  streamlined  man¬ 
agement  concept  advocated  by  the 


The  overall  objectives  of  the  PMCS 
were  to  'provide  improved  manage¬ 
ment,  program  stability  and  increased 
cost  discipline  in  the  weapon  system 
acquisition  process  at  all  levels.''13  In 
addition  to  this  overarching  objective, 
the  PMCS  provided  an  early  warning 
system  of  potential  program  deviations 
through  monthly  reporting  to  the 
highest  levels  of  Army  leadership,  and 
improved  program  reporting,  con¬ 
trolled  program  changes,  and  devel¬ 
oped  a  consensus  supporting  program 
requirements.14 

Under  the  PMCS  process,  there  were 
two  types  of  baselines:  The  primary 
baseline  was  a  major  command 
(MACOM)  level  baseline  representing 
agreement  among  program  partici¬ 
pants  on  major  programs,  signed  by 
the  PM  and  approved  by  the  Com¬ 
mander,  Army  Materiel  Command 
(AMC),  and  the  Commander,  Train- 
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ing  and  Doctrine  Command 
(TRADOC);  the  Army  Secretariat; 
Army  Chief  of  Staff  and  Vice  Chief  of 
Staff;  Army  Headquarters  Staff 
(ARSTAF);  and  signed  by  the  Deputy 
Chief  of  Staff,  Research,  Development 
and  Acquisition  (DCSRDA).  This  ap¬ 
proval  scheme  resembles  the  Air  Force 
process  of  wide  staff  coordination  and 
consensus-building  among  essential 
program  participants.  In  addition  to 
this  major  category  of  PMCS  baseline, 
the  Major  Subordinate  Army  Com¬ 
mands  (MSC)  and  the  MACOMs 
selectively  tailored  the  PMCS  process 
for  application  to  non-major  systems. 

The  essential  PMCS  baseline  docu¬ 
ment  was  the  Program  Directive  Docu¬ 
ment  (PDD),  consisting  of  information 
in  program  description,  acquisition 
strategy,  integrated  logistics  support, 
testing,  design-to-cost,  reliability 
growth,  and  the  Army/ Office  of  the 
Secretary  of  Defense  (OSD)  funding 
profile,  including  RDT&E,  procure¬ 
ment,  MILCON  and  O&S  costs.  Usu¬ 
ally,  the  initial  PDD  was  established  at 
Milestone  I.  An  Annual  Execution 
Plan  (AEP)  served  as  an  appendix  to 
the  PDD  and  was  the  PM's  plan  for  ex- 
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ecuting  the  approved  program.  The 
AEP  incorporated  the  changes  in  the 
latest  President's  Budget  and  the 
associated  Five  Year  Defense  Plan 
(FYDP).  Changes  to  the  approved 
baseline  were  formalized  and  require 
DCSRDA  approval.  Each  PM  com¬ 
pleted  Monthly  Program  Status 
Reports  (MPSR)  indicating  the  success 
to  date  of  the  AEP. 

Recent  revisions  to  the  Army  pro¬ 
cess  outlined  above  were  accomplished 
to  accommodate  the  program-report¬ 
ing  changes  in  Department  of  Defense 
policy.  These  changes  retain  the  basic 
concept  with  incorporation  of  the 
streamlined  management  approach  as 
the  primary  difference.  These  revisions 
include  approved  authority  only  of  the 
PM,  PEO,  SAE  and  DAE  and  a  focus 
on  Army  Selected  Acquisition  Report 
(SAR)  programs  for  which  baselines 
are  being  established  for  DOD-level 
approval.  Also,  the  revised  baselining 
concept  is  being  applied  to  all  pro¬ 
grams,  including  extension  to  PEO- 
manager  programs.  On  a  selective 
basis,  the  concept  will  extend  to  the 
SAE  level.  In  addition,  the  PDD  has 
been  modified  to  reflect  the  pro¬ 


gram  information  requirements  of 
DoDD  5000.45,  Baselining  of  Selected 
Major  Weapons  Systems  and  public 
law  (Title  10,  United  States  Code, 
Chapter  144,  Section  2435). 

For  several  years,  each  military  ser¬ 
vice  has  controlled  program  instabili¬ 
ties  and  cost  growth  through  a  man¬ 
agement  mechanism.  The  three  mili¬ 
tary  service  systems  differ  in  various 
respects,  including  the  degree  of  infor¬ 
mation  detail  required  and  the  timing 
of  the  initial  establishment  of  the  base¬ 
line.  However,  the  systems  share  a 
common  purpose — to  enhance  man¬ 
agement  effectiveness  by  gaining  some 
control  over  critical  program  parame¬ 
ters.  Table  1  and  Figure  1  summarize 
the  similarities  and  differences  among 
the  military  service  baselining  systems 
and  compare  them  with  the  current 
DOD  system. 

Baselining;  Recent  History 

In  July  1985,  President  Reagan,  beset 
by  procurement  scandals  in  the  media 
and  repeated  calls  for  defense  reform 
action,  appointed  former  Deputy 
Secretary  of  Defense  David  Packard  to 
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head  a  commission  charged  "...to  con¬ 
duct  a  detense  management  study  of 
important  dimension."  The  President's 
Blue  Ribbon  Commission  on  Defense 
Management  or,  more  familiarily,  the 
Packard  Commission,  studied  a  broad 
range  of  defense  issues,  including  plan¬ 
ning  and  budgeting,  military  organiza¬ 
tion  and  command,  and  government- 
industry  accountability.  Also,  they  ex¬ 
plored  acquisition  organization  and 
procedures  and  made  several  major 
recommendations  to  improve  the  ac¬ 
quisition  process.  Subsequently,  many 
were  enacted  into  legislation;  included 
was  the  establishment  of  an  Under 
Secretary  of  Defense  for  Acquisition. 
One  recommendation  which  found  its 
way  into  permanent  codification  was 
maior  program  baselining. 

In  tandem  with  the  work  of  the 
Packard  Commission,  the  Congress  in¬ 
tensified  its  oversight  of  the  defense  ac¬ 
quisition  process  and  held  numerous 
hearings  on  acquisition  reform.  A 
broad  spectrum  of  witnesses,  including 
former  and  current  military  service 
chiefs  of  staff  and  industrial  executives, 
were  called  before  congressional  com¬ 
mittees  to  testify  on  their  perceptions 
of  problems  plaguing  the  acquisition 
process  and  to  offer  their  prescriptions 
for  improvement.  The  result  of  this  un¬ 
precedented  degree  of  congressional  in¬ 
vestigation  into  executive  branch 
operations  was  a  bonanza  of  legisla¬ 
tion  covering  almost  every  aspect  of 
the  acquisition  process,  from  com¬ 
petitive  prototyping  strategies  to 
estimating  manpower  requirements  for 
systems  at  the  initiation  of  FSD. 
Baselining  of  major  programs,  of 
course,  became  law. 

What  did  the  Packard  Commission 
and  the  Congress  say  about  baselining? 
What  were  their  respective  intentions? 
In  its  final  report  to  the  President,  the 
Packard  Commission  stated,  "Program 
stability  must  be  enhanced  in  two  fun¬ 
damental  ways.  First.  DoD  should  ful¬ 
ly  institutionalize  baselining'  for  ma¬ 
jor  weapon  systems  at  the  initiation  of 
F-qn  Sprnnrt  DnD  and  Congress 
should  expand  the  use  of  multi-year 
procurement  for  high-priority 
systems. Clearly,  David  Packard 
envisioned  "tully  institutionalized" 
baselining  tor  enhancing  program 
stability.  To  complete  the  endeavor, 
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Mr.  Packard  contended  the  Congress 
should  approve  multi-year  funding  of 
the  baselined  program. 

A  careful  reading  of  the  Packard 
report  reveals  that  the  baselining  of 
which  the  commissioners  were  speak¬ 
ing  was  not  intended  as  merely  a 
means  of  improving  program  reporting 
and  elevating  programmatic  issues  to 
departmental  leadership.  To  the  con¬ 
trary,  Packard  et  al  were  describing  an 
organizational  commitment  to  a  par¬ 
ticular  program  profile,  a  commitment 
that  would  be  shared  by  congressional 
authorizing  and  appropriating  com¬ 
mittees.  The  distinction  is  critical, 
somewhat  obscure,  and  at  the  center 
of  current  baselining  dialogue.  Does 
the  baseline  represent  a  shared  com¬ 
mitment  of  program  participants  to 
preserve  a  particular  program  profile, 
with  the  attendant  reductions  or  even 
terminations  of  lesser  priority  pro¬ 
grams  (i.e.,  non-baselined)  that  is  im¬ 
plicit  in  this  approach?  Or  is  the 
baseline  a  mechanism  by  which  to  im¬ 
prove  program  reporting  and  ensure 
the  elevation  of  program  status  to  up¬ 
per  management?  The  latter  philo¬ 
sophy  reflects  a  "management  control 
system.''  As  one  writer  has  described 
the  purpose  of  these  systems,  "...man¬ 
agement  needs  some  way  to  assure  that 
people  in  the  organization  are  doing 
what  they  are  supposed  to  do."16  The 
former  concept,  however,  implies  a 
selective  system  of  ranking  and 
building  programmatic  priorities. 

The  Congress,  relying  heavily  on 
Commission  recommendations,  legis¬ 
lated  major  program  baselining  in  the 
Fiscal  Year  1987  National  Defense 
Authorization  Act.  In  the  legislation, 
the  Congress  required  the  Secretary  of 
each  military  department  to  establish 
a  baseline  description  for  major 
defense  acquisition  programs  before 
such  programs  entered  FSD  or  Full- 
Rate  Production  (FRP).  The  passage  of 
the  Authorization  Act  occurred  just  2 
months  after  the  department  issued  a 
baselining  directive,  DoDD  5000.45, 
Baselining  of  Selected  Major  Weapons 
Systems.  The  Department  of  Defense, 
in  issuing  the  baselining  directive, 
responded  rather  promptly  to  the 
Packard  Commission  recommenda¬ 
tions,  but  not  promptly  enough  to 
avoid  legislation.  This  is  not  to  imply 
that,  in  and  of  itself,  legislative  re- 
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quirements  represent  an  undue  com¬ 
plication  of  the  policy  process. 
However,  this  is  often  the  case  in  cer¬ 
tain  policy  areas,  because  there  are 
often  myriad  policy  disconnects  be¬ 
tween  the  new  legislation  and  the  ex¬ 
tant  executive  branch  regulation  that 
must  be  ferreted  through  and  resolved. 
For  example,  the  law  was  similar  in 
many  respects  to  the  recently  estab¬ 
lished  departmental  baselining  policy, 
but,  predictably,  did  differ  significant¬ 
ly  in  a  few  crucial  areas.  Figure  2, 
DOD  Baselining  Requirements  and 
Public  Law:  A  Comparison,  depicts 
similarities  and  differences. 

In  issuing  DoDD  5000.45  (August 
1986),  the  Department  of  Defense 
relied  on  the  Packard  recommenda¬ 
tions  as  well  as  existing  Air  Force 
baselining  policy.  The  directive  re¬ 
quired  the  establishment  of  baselines 
for  all  major  programs  as  they  entered 
FSD  and  production.  The  baseline 
established  at  FSD  would  contain  total 
development  costs  and  a  unit  produc¬ 
tion  cost  goal  and  become  the  develop¬ 
ment  baseline.  The  baseline  established 
at  the  production  decision  point  would 
contain  the  average  unit  production 
cost  and  a  total  procurement  cost  pro¬ 
file  and  would  become  the  production 
baseline.  The  establishment  of  two 
baselines,  one  for  development  and 
one  for  production,  was  deemed  neces¬ 
sary  because  of  uncertainty  still 
associated  with  many  program  para¬ 
meters,  such  as  production  and  sup¬ 
port  costs,  at  the  initiation  of  FSD.  It 
was  contended  that  requiring  baselin¬ 
ing  of  total  production  costs  and  ap¬ 
plying  strict  deviation  criteria  to  these 
parameters  too  early  in  the  program's 
cycle  would  virtually  ensure  a  baseline 
cost  breach  situation. 

The  DoDD  5000.45  also  called  for 
the  inclusion  of  "important  events  such 
as  initial  operating  capability  and  first 
deployment"  and  "those  system  perfor¬ 
mance  parameters  that  are  considered 
critical  to  the  success  of  the  system 
mission"  and,  for  production  baselines, 
a  "validated  estimate  of  the  cost  of  the 
remaining  program"  and  a  "production 
delivery  schedule."  These  requirements 
reflected  concern  for  monitoring  only 
program  characteristics  absolutely  nec¬ 
essary  for  DAE  management  purposes. 
The  immense  detail  of  the  Air  Force 
system  was  clearly  not  envisioned. 
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Secretary,  MilDept.  convenes  Review  Panel  and 
Submits  Report  to  USD(A)  within  45  Days 


The  directive  also  mandated  that 
"major  programs  currently  in  FSD  cr 
production  will  be  baselined  within  90 
days  after  the  effective  date  of  this 
directive  ("90  days  after"  equated  to 
November  26,  1986).  This  passage  in 
DoDD  5000.45  was  thoroughly  misun¬ 
derstood,  perhaps  with  good  reason, 
by  the  military  services,  none  of  whom 
submitted  a  baseline  for  approval  as  of 
the  90-day  deadline.  For  several  rea¬ 
sons,  this  statement  was  interpreted  by 
the  military  services  as  contradictory 
guidance  in  the  context  of  the  entire 
directive.  First,  the  directive  is  entitled 
Baselining  of  Selected  Major  Systems 
and  implies  that  the  baselining  process 
described  in  the  directive  will  be  ap¬ 
plied  only  to  certain  major  programs 
meeting  specific  criteria.  Yet,  the  direc¬ 
tive  called  for  baselining  all  major  pro¬ 
grams  "within  90  days."  Second,  the 
directive  states  the  Service  Acquisition 
Executive  (SAE)  shall  recommend  to 
the  DAE  which  major  programs  fall¬ 
ing  under  SAE  jurisdiction  should  be 
baselined.  Again,  this  responsibility 
implies  selectivity 

Consequently,  the  military  service 
response  tended  to  exploit  the  Conflict- 
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ing  policy  signals  of  DoDD  5000.45, 
primarily  because  the  baseline  breach 
procedures  it  established  portended 
numerous  Joint  Requirements  and 
Management  Board  (JRMB),  now  the 
Defense  Acquisition  Board  (DAB), 
reviews.  These  reviews  would  be  trig¬ 
gered  if  a  system  performance  require¬ 
ment  was  not  met;  a  milestone  was 
missed  by  more  than  90  days;  or  costs 
increased  by  more  than  15  percent  for 
a  development  baseline  or  5  percent  for 
a  production  baseline.  The  perfor¬ 
mance  deviation  was  probably  per¬ 
ceived  as  the  most  constraining  of  the 
above  margins,  especially  when  stipu¬ 
lated  in  a  development  baseline, 
because  the  potential  for  redefining 
performance  requirements  and  restruc¬ 
turing  performance  capabilities  during 
the  design  and  testing  process  was 
significant.  This  concern  was  exacer¬ 
bated  by  the  lack  of  a  "goal  and 
threshold"  mechanism  for  articulating 
and  measuring  performance  factors,  at 
least  in  the  development  baseline 
phase.  The  DoDD  5000.45  did  cali  for 
a  "full  set  of  demonstrated  system  per¬ 
formance  parameters,  together  with 
acceptable  limits  of  variation  of  these 
parameters"  in  establishing  a  produc¬ 


tion  baseline.  By  the  time  the  system 
is  developed  and  tested  and  gains  ap¬ 
proval  to  begin  production,  technical 
and  operational  performance  charac¬ 
teristics  should  be  significantly  more 
stable  than  they  were  at  the  inception 
of  FSD. 

The  department's  initial  step  toward 
institutionalizing  baselining  was,  in  ef¬ 
fect,  a  false  one.  The  military  service 
response  to  issuing  DoDD  5000.45 
was  negligible,  partly  because  of  in¬ 
herent  contradictions  of  the  directive. 
Another  reason  may  be  the  OSD  and 
military  departments  adversarial  rela¬ 
tionship  led  many  observers  to  con¬ 
clude  no  one  was  in  charge  of  the  ac¬ 
quisition  system.  In  part,  this  percep¬ 
tion  served  as  the  primary  catalyst  for 
creating  the  Packard  Commission. 

Issuing  DoDD  5000.45  and  passing 
the  baselining  statute  coincided  with 
the  arrival  of  Richard  P.  Godwin,  a 
former  executive  of  the  Bechtel  Cor¬ 
poration,  the  first  person  to  occupy  the 
newly  created  position  of  Under 
Secretary  of  Defense  for  Acquisition. 
Mr.  Godwin  arrived  at  the  Pentagon 
amid  great  expectations  from  sup¬ 
porters  on  Capitol  Hill  and  in  the 
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Department  of  Detense.  Mr.  Godwin 
perceived  his  mandate  as  very  clear:  to 
wrestle  management  control,  by  bur¬ 
eaucratic  force  if  need  be,  of  the  DOD 
acquisition  system  and  make  it  more 
efficient  and  effective.  Baselining  of 
major  programs  figured  very  promi¬ 
nently  into  this  effort. 


Mr.  Godwin  viewed  baselining 
much  more  broadly  than  the  Depart¬ 
ment  of  Defense  and  the  Congress.  The 
DoDD  5000.45  and  baselining  statute 
called  for  the  establishment  of  program 
baselines  at  FSD  and  production.  He 
contended  that  programs  "shouldn't 
break  their  budgets"  and  that  a  pro¬ 
gram  should  adhere  to  a  particular 
baseline  from  its  inception  through  the 
phases  of  the  acquisition  cycle.  Soon 
after  his  official  arrival,  Mr.  Godwin 
was  apprised  of  the  status  of  baselin¬ 
ing  (i.e.,  DoDD  5000.45  had  been  inef¬ 
fective  thus  far).  In  a  January  5,  1987, 
memorandum  to  the  SAEs,  Mr. 
Godwin  chided  the  military  services 
for  their  lack  of  response  and  requested 
they  nominate  candidates  for  base¬ 
lining: 


The  directive  calls  for  the  sub¬ 
mission  of  candidate  systems  to 
be  baselined  within  90  days  after 
its  issuance.  As  of  November  25, 
108o  (90  days  after  issuance  of 
the  directive),  no  candidate  sys¬ 
tems  had  been  submitted  to 
OSD 


In  order  to  adhere  to  the  tight 
budget  preparation  schedule  the 
candidate  systems  are  requested 
to  be  submitted  to  my  office 
(attn:  JRMB  Secretary)  by 
January  15,  1987. 
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characteristics:  1)  managed  in  a 
streamlined  manner  ( PM-PEO-SAE ); 
21  program  office  struc  tured  to  accom¬ 
modate  staff  positions  for  technical 
staff  (business  management,  auditing, 
engineering,  etc.);  3)  regulatory  relief 
to  be  provided;  and  4)  eligible  for 
Milestone  Authorization  by  the  Con¬ 
gress  (baselines  to  be  submitted  to  the 
Congress  if  request  for  milestone 
authorization  is  made).  The  following 
programs  were  designated  DEPs: 
Army:  Mobile  Subscriber  Equipment 
(MSE);  Tube-Launched  Optically- 
Wire-Guided  Missile  (TOW  II);  Army 
Tactical  Missile  System  (ATACMS). 
Navy;  T-45  Jet  Training  System 
(T-45TS);  TRIDENT  D-5  Missile; 
SSN-21  Attack  Submarine.  Air  Force; 
Delta  II;  TITAN  IV  Rocket;  C-17 
Airlift  Aircraft;  Short  Range  Attack 
Missile  (SRAM  II)). 


The  initial  OSD  response  was  to 
concentrate  effort  on  establishing 
baselines  for  the  DEPs  that  had  been 
requested  for  milestone  authorization. 
Submitting  baselines  for  these  pro¬ 
grams  to  the  House  and  Senate  Armed 
Services  Committees  within  90  days  of 
the  original  request  was  required  by 
law  and,  thus,  deemed  to  be  the  high¬ 
est  priority  in  the  baselining  effort. 
After  a  detailed  internal  review,  the 
Secretary  decided  to  officially  request 
milestone  authorization  for  three  of  the 
DEPs,  MSE,  D-5  and  Delta  II.  The 
military  services  were  directed  to 
prepare  and  submit  baselines  for  these 
programs.  According  to  the  legislation, 
the  baselines  for  these  programs  were 
to  be  in  accordance  with  Section  2435 
of  Title  10  (Figure  2). 


The  Air  Force  and  Navy  responded 
that  the  Programs  designated  as  Enter¬ 
prise  Programs*  would  be  ideal  candi¬ 
dates  for  baselining.  The  Army 
responded  that  the  Army  Selected  Ac¬ 
quisition  Reports  (SAR)  programs  con¬ 
stituted  an  appropriate  set  for  baselin¬ 
ing  purposes. 


* The  Defense  Enterprise  Program 
<DEP)  was  created  by  the  Fiscal  Year 
1487  National  Defense  Authorization 
Act  It  established  a  mechanism  by 
which  the  Secretary  of  Defense  and  the 
Military  Department  Secretaries  could 
designate  certain  programs  as  DEPs. 
The  DEPs  would  have  the  following 


While  this  work  was  proceeding,  the 
DAE  considered  the  military  service 
proposals  regarding  program  can¬ 
didates  for  baselining.  The  Air  Force 
and  Navy  recommended  baselining 
only  the  DEPs  at  the  DAE  level;  the 
Army  advised  that  the  SAR  programs 
(in  FSD  or  Production)  would  be  ap¬ 
propriate.  The  Air  Force  and  Navy 
proposals  were  attractive  from  the 
standpoint  of  winnowing  the  scope  of 
the  DOD-wide  baselining  initiative  to 
a  few,  high-priority  major  programs. 
This  approach  resembled  the  concept 
of  the  stable  programs  list,  first  ar¬ 
ticulated  in  1981  as  part  of  the  im¬ 
plementation  of  the  Defense  Acquisi¬ 
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tion  Improvement  Program.  This  con¬ 
cept  held  that  management  attention 
should  concentrate  on  a  select  list  of 
high-priority  programs,  which  would 
be  preserved  through  the  various 
phases  of  the  PPBS  process.  The  ad¬ 
vantage  of  the  Army  approach  was 
that  it  emphasized  the  necessity  of  ac¬ 
tively  managing  all  major  programs. 
It  was  this  philosophy  that  more  close¬ 
ly  coincided  with  the  view  in  OSD  and 
the  Congress  that  DOD  should  man¬ 
age  its  vast  resources  more  effective¬ 
ly.  Consequently,  the  DAE  decided 
DoDD  5000.45  would  be  enforced  for 
all  major  programs  in  FSD  or 
Production. 


On  June  15,  1987,  after  preparation 
and  submittal  of  the  milestone 
authorization  program  baselines  was 
almost  complete,  Mr.  Godwin  signed 
a  memorandum  to  the  military  services 
that  stated,  in  part: 


Until  such  time  as  program 
baselines  are  provided  for  all  ma¬ 
jor  systems  in  accordance  with 
DoDD  5000.45,  the  program 
parameters  (cost,  schedule  and 
technical  /operational )  contained 
in  the  Selected  Acquisition 
Reports  (SAR)  shall  comprise  the 
program  baselines  for  manage¬ 
ment  and  oversight  purposes. 


The  parameters  to  be  considered 
part  of  the  program  baselines  are 
as  follows: 


Schedule  Milestones:  Section  9a 
of  the  SAR 


Technical/Operational:  Section 
10a  and  b 


Cost:  Section  16c  and  Section 
11c  and  d. 


Variances  of  15%  for  R&D 
parameters  and  5%  for  produc¬ 
tion  and  deployment  parameters 
will  be  applied  to  the  baseline 
values  to  determine  when  a 
breach  of  the  baseline  occurs. 


Several  significant  issues  emerge 
from  this  memorandum.  The  SAR,  for 
example,  had  heretofore  never  been 
utilized  as  a  baseline  document,  but 
rather  as  a  reporting  mechanism  on 
program  progress.  The  OSD  primary 
motives  were  to  prod  the  military  ser¬ 
vices  to  establish  baselines 
simultaneously  for  all  major  programs 
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in  FSD  or  Production  (the  original  in¬ 
tent  of  DoDD  5000.45)  and  erect  a 
temporary  baseline  document  in  the  in¬ 
terim.  Such  an  action  was  deemed 
necessary  by  the  inordinate  delay  ex¬ 
perienced  thus  far  in  establishing 
baselines  Poy  this  point,  it  had  been 
nearly  a  full  year  since  DoDD  5000.45 
was  originally  issued).  In  one  move, 
baselines,  albeit  inherently  temporary 
in  nature,  for  over  100  major  programs 
were  suddently  created.  Soon  after 
this  action  was  taken.  Secretary 
Weinberger  approved  the  baselines  for 
the  three  milestone  authorization  pro¬ 
grams  and  forwarded  them  to  the 
Congress. 

Baselining:  Current  Status  and 
Remaining  Issues 

Submittal  and  Review  Process.  The 
military  services'  initial  reaction  to  the 
memorandum  of  June  15,  1987,  was 
muted  but  slowly  began  to  filter  in. 
Primary  among  objections  was  the 
SAR  as  a  mechanism  by  which  to  es¬ 
tablish  program  baselines.  The  SAR  is 
a  program  "budget"  report,  submitted 
to  the  Congress  annually.  It  provides 
the  current  status  of  a  program  across 
categories,  including  technical  and 
operational  performance  characteris¬ 
tics,  total  program  costs  and  unit  costs, 
and  schedule  information.  The  SAR 
also  includes  other  pertinent  informa¬ 
tion,  such  as  program  and  mission 
description,  significant  issues,  signifi¬ 
cant  changes  since  the  last  SAR,  etc. 
The  Congress  can  request  a  SAR  at 
any  point  in  the  acquisition  cycle,  but 
normally  a  SAR  is  initiated  for  a  pro¬ 
gram  at  the  inception  of  FSD  and  is 
continued  until  the  program  has 
achieved  90  percent  of  its  planned 
production. 

The  military  services  objections  to 
the  interim  solution  posed  by  the  June 
15  memorandum  argued  the  following: 
1 )  The  SAR  was  primarily  an  historical 
document  that  merely  updates  the 
status  of  a  program  at  budget  time 
tie.,  submittal  of  the  President's 
Budget  to  the  Congress);  2)  The  SAR 
does  not  undergo  the  rigorous  review 
and  approval  process  that  a  program 
baseline  does;  3)  The  SAR  preparation 
does  not  occur  in  conjunction  with  a 
Milestone  review;  4)  The  SAR  is  sub¬ 
mitted  to  the  Congress  and  including 
the  baseline  in  it  would  invite  addi- 
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tional  congressional  micromanage¬ 
ment;  and  5)  The  SAR  would  prove  to 
be  a  better  baseline  reporting  docu¬ 
ment.  Once  again,  the  essential 
philosophical  argument  on  the  nature 
of  a  program  baseline  emerges — bud¬ 
get  and  program  reporting  versus 
management  commitment  to  a  speci¬ 
fied  program, 

Although  OSD  management  agreed 
in  principle  with  many  of  these 
arguments,  it  still  felt  obliged  to  create 
an  interim  baseline  until  official 
baselines  had  been  approved.  In  the 
aftermath  of  the  June  15  direction, 
there  was  much  dialogue  and  debate 
but  still  no  formally  established 
baselines.  Once  again,  in  a  memoran¬ 
dum  of  August  26,  1987,  the  DAE 
directed  the  military  services  to 
prepare  and  submit  baselines  for 
approval: 

Major  system  baselining  is  re¬ 
quired  by  DoDD  5000.45  and  by 
public  law.  [Service  compliance] 
is  not  adequate  and  does  not  res¬ 
pond  to  either  departmental  or 
legislative  direction.  According¬ 
ly,  it  is  requested  that  the  [Ser¬ 
vices]  submit  baselines  for  all  ap¬ 
plicable  programs  no  later  than 
September  18,  1987.  Any  base¬ 
line  breached  must  be  reviewed 
by  the  Service  and  reported  to 
the  DAE. 

The  tone  of  this  memorandum 
reflected  the  rising  frustration  of  OSD 
management  with  the  pace  of  the 
baselining  effort  as  well  as  a  sensitivi¬ 
ty  to  effective  compliance  with  the 
recommendations  of  the  Packard 
Commission  and  the  provisions  of  the 
baselining  statute. 

The  military  services  are  responding 
to  the  August  26  direction;  baselines 
were  submitted  for  all  applicable  pro¬ 
grams  as  of  January  1988  (see  T able  2) . 
The  review  process  at  the  OSD  level, 
thus  far,  has  focused  primarily  on  the 
performance  section  of  the  baselines, 
attempting  to  ensure  that  the  opera¬ 
tional  and  technical  characteristics  in¬ 
cluded  in  the  baseline  represent  the 
most  critical  parameters  for  the  pro¬ 
gram  in  question.  Ascertaining 
whether  this  is  the  case  depends  on  an 
understanding  of  the  program's  mis¬ 
sion  and  the  capabilities  necessary  to 


perform  effectively.  Automated  mes¬ 
sage  handling  rate,  for  example,  would 
be  a  prime  performance  factor  for  an 
information  and  communications  sys¬ 
tem;  however,  it  would  be  a  meaning¬ 
less  factor  for  a  ballistic  missile.  Simi¬ 
larly,  correctly  structuring  the  perfor¬ 
mance  section  of  the  baseline  depends 
on  program  timing.  Tracking  a  static 
design  parameter  such  as  weight  for  a 
missile  in  full-rate  production  would  be 
a  futile  exercise;  however,  monitoring 
such  a  parameter  for  a  cargo  airlift  air¬ 
craft  program  in  the  midst  of  a  devel¬ 
opment  effort  would  be  well-advised. 

The  review  process  encompassed 
also  the  Cost  and  Schedule  sections  of 
the  baseline.  In  cost,  the  review  fo¬ 
cused  on:  1)  agreement  of  costs  with 
data  reflected  in  official  budget 
documentation  (e.g.,  FYDP,  Congres¬ 
sional  Data  Sheets);  2)  display  of  costs 
in  Then-Year  dollars  as  well  as  Base- 
Year  dollars;  and  3)  technical  review 
to  ensure  mathematical  accuracy.  The 
second  point  was  not  an  original  re¬ 
quirement  of  DoDD  5000.45  or  public 
law,  but  was  a  policy  decision  that  the 
cost  section  of  the  baseline  must  reflect 
the  impact  of  inflation  and  must  be 
conversant  with  other  management 
reports  (e.g.,  SAR)  that  include  Then- 
Year  dollar  tables. 

In  scheduling,  the  review  focused 
on:  1)  including  important  future 
schedule  events;  2)  management 
deciding  what  constitutes  important 
baseline  events;  3)  including  some 
historical  events  in  the  interest  of  pro¬ 
viding  an  adequate  context  for  deci¬ 
sion-makers;  and  4)  technical  review 
to  ensure  accuracy.  In  deciding  what 
comprises  important  schedule  events 
for  baseline  purposes,  the  focus  was  on 
program  events  that  could  potentially 
upset  completion  of  a  major  acquisi¬ 
tion  phase  or  achievement  of  a  major 
milestone  (e.g.,  FSD  or  Initial  Opera¬ 
tional  Capability).  Completion  of 
developmental  and  operational  testing, 
for  example,  are  critical  dates  because 
they  reflect  the  success  or  failure  of  the 
testing  program  and  the  attendant  fluc¬ 
tuations  in  the  remainder  of  the  pro¬ 
gram.  The  FSD  and  Production  con¬ 
tract  award  dates  are  not  as  significant 
in  terms  of  baselining  because  these 
events  occur  after  major  reviews, 
Milestone  II  or  III  approval  by  the 
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ARMY 

NAVY 

AIR  FORCE 

_ 

ADDS 

A-6E/F 

PHOENIX 

AMRAAM 

SRAM  II 

AH -64 

AN/BSY-1 

SEA  LANCE 

ASAT 

TACIT  RAINBOW 

AHIP 

AN/BSY-2 

SH-60B 

ATARS 

TITAN  IV 

ASAS 

AN/SQQ-89 

SH-60F 

B-1B 

TRI-TAC 

AT AC MS 

ASPJ 

SPARROW 

C-5B 

WIS 

BFVS 

AV-8B 

SSN-21 

C-17A 

CH-47D 

C/MH-53E 

AAN-688 

CSRL 

COPPERHEAD 

CG-47 

SM-2 

DMSP 

FAADS  C2I 

CVN  68  CLASS 

T-45TS 

DSCS  III 

HELLFIRE 

DDG-51 

TOMAHAWK 

DSP 

M-1  TANK 

E-2C 

D-5MISSILE 

F-15 

MLRS 

E-6A 

TRIDENT  SUB 

F-16 

MSE 

EA-6B 

V- 22 

IR  MAVERICK 

PATRIOT 

F-14D 

JSTARS 

SINCGARS 

F/A-18 

JTIDS 

STINGER 

HARM 

KC-135R 

TOW  II 

HARPOON 

LANTIRN 

UH-60A 

LCAC 

NAVSTAR 

LHD 

OTH-B 

LSD-41 

PEACEKEEPER 

MK-48 

RAIL  GARRISON 

'This  list  is  still 

MK-50 

SFW 

being  revised  as 

P-3C 

of  this  writing. 
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Defense  Acquisition  Board  (DAB), 
already  contained  in  the  baseline. 

The  DAE  will  approve  all  military 
service  baselines  via  a  "policy 
memorandum''  that  formally  estab¬ 
lishes  DOD-level  baselines  and  pro¬ 
mulgates  baselining  policy  for  the 
future.  The  first  of  these  policy 
memoranda  was  issued  on  February  9, 
1988,  to  the  Air  Force  (Air  Force 
baselines  were  the  first  submitted  to 
OSD  for  review).  This  memorandum 
approved  all  Air  Force  baseline  sub¬ 
mittals  "contingent  upon  the  addition 
of  certain  critical  information"  and  in¬ 
cluded  guidance  for  the  future: 

We  are  revising  the  Defense  Ac¬ 
quisition  Executive  Summary 
(DAES)  to  incorporate  the  base¬ 
lines  and  to  track  compliance 
with  baseline  parameters.  I 
would  like  you  to  incorporate 
the  complete  program  baselines 
into  the  DAES  system  as  soon  as 
possible.  In  the  future,  baselines 
will  be  proposed  in  the  appropri¬ 
ate  sections  of  the  milestone 
documentation  (e.g..  Decision 
Coordinating  Paper)  and  ap¬ 
proved  in  conjunction  with  the 
milestone  decision.  DoDD 

Program  Manager 


5000.45  will  be  rescinded  and 
revised  baselining  guidance  will 
be  included  in  DoDI  5000.2. 

The  DAE  policy  memorandum  is 
significant  for  several  reasons.  First,  it 
affirms  the  importance  of  the  baselin¬ 
ing  concept  to  effective  management. 
Second,  it  more  closely  relates  baseline 
establishment  to  the  milestone  review 
process  and  eliminates  the  need  for  a 
separate  baseline  document.  Third,  it 
establishes  a  process  for  reviewing 
baseline  progress.  Although  final  ap¬ 
proval  of  all  baselines  for  all  FSD  and 
Production  major  programs  and  pro¬ 
mulgation  of  revised  baselining  guid¬ 
ance  represent  significant  milestones  in 
the  program  stability  effort,  much 
work  will  remain  to  be  done  and  many 
issues  will  have  to  be  resolved. 

Remaining  Issues 

After  major  program  baselines  are 
initially  established,  issues  still  to  be 
resolved  include: 

—  Baseline  Administration.  Rigorous 
administration  of  baseline  parameters 
and  strict  adherence  to  major  elements 
of  baselining  policy  is  absolutely 
necessary  to  make  the  baselining  effort 
truly  meaningful  (see  Figure  3).  A  ma¬ 
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jor  part  of  rigorous  enforcement  in¬ 
volves  tracking  baseline  breaches 
closely;  to  accomplish  this,  the  SAR 
and  DAES  reports  will  be  used  exten¬ 
sively.  The  DAES  report  will  be  a 
quarterly  rather  than  a  current  month¬ 
ly  report  and  will  contain  not  only  all 
baseline  information  (cost,  schedule 
and  performance),  but  also  will  serve 
as  the  mechanism  by  which  actual 
baseline  deviations  and  potential 
baseline  deviations  are  reported  to  the 
DAE.  Of  course,  the  SAE  will  be  ex¬ 
pected  to  review  baseline  deviations 
and  offer  alternative  courses  of  action 
for  the  DAE  to  consider. 

The  distinction  between  actual  and 
potential  baseline  deviations  is  critical. 
As  the  PPBS  process  moves  from  the 
programming  to  the  budgeting  phase, 
many  tentative  decisions  are  made 
and,  in  many  cases,  subsequently  un¬ 
made.  A  POM  proposal  to  increase 
quantities  for  Program  X  may  be  over¬ 
turned  during  the  Program  Review  via 
the  PDM  and  modified  once  again  in 
a  PBD  action.  Of  course,  once  con¬ 
tained  in  the  President's  Budget,  the 
proposal  can  again  be  adjusted  by  con¬ 
gressional  action.  Consequently,  when 
the  POM  is  submitted  to  OSD  for 
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review  and  adjustment,  the  program 
manager  can,  at  best,  only  assess  the 
potential  impacts  to  the  baseline;  these 
potential  impacts  may  still  be  shaped 
by  future  PPBS  or  congressional 
action. 

—  Baseline  Breaches  and  Defense  Ac¬ 
quisition  Board  <DAB)  Review.  One 
major  area  of  contention  in  baselining 
policy  has  been  the  review  activity  of 
the  DAB  that  a  baseline  breach  might 
trigger.  Justifiably  concerned  by  this 
possibility,  the  military  services  have 
been  somewhat  reluctant  to  baseline 
certain  performance  (as  well  as  cost 
and  schedule!  parameters  for  fear  that 
slippage  in  any  of  these  (including 
tact-of-life"  breaches — those  directly 
caused  by  congressional  or  OSD  ac¬ 
tion'  would  automatically  cause  a  full- 
scale  DAB  review  of  the  program. 
Even  if  the  DAB  chairman  were  pre¬ 
disposed  to  initiate  reviews  for  every 
baseline  breach  that  occurred,  it  would 
be  a  physical  impossibility;  congres¬ 
sional  action  alone  will  cause  myriad 
deviations  from  previous  baseline 
levels.  More  realistically,  the  DAB 
chairman  'and  staff)  will  assess  the 
significance  of  the  deviation  on  a  case- 
by-case  basis  and  then  decide  if  a  DAB 
review  is  warranted.  Substantial 


degradation  in  performance  capabili¬ 
ty  or  severe  cost  growth  will  probably 
be  the  prime  considerations  in  this 
decision.  The  February  9  DAE  policy 
memorandum  states,  "baseline 
breaches  will  not  necessarily  warrant 
a  DAB  review." 

—  The  DOD  Legislative  Harmony.  An 
important  issue  for  future  baselining 
policy  is  ensuring  full  harmony  be¬ 
tween  the  baselining  requirements  of 
legislation  and  DOD  policy.  The  two 
are  essentially  synonymous  at  this 
point,  although  that  was  not  always 
the  case,  due  primarily  to  the  ad¬ 
ministrative  lag  of  the  legislative  pro¬ 
cess.  As  initially  passed,  the  baselining 
statute  (now  embodied  in  Title  10, 
U.S.  Code,  Section  2435)  conflicted 
with  previously  established  DOD  base¬ 
lining  policy  in  the  area  of  deviation 
margins.  The  original  version  of  the 
law  allowed  for  no  margin  in  cost  or 
schedule  parameters  whereas  DoDD 
5000.45  allowed  for  5  percent  (produc¬ 
tion)  and  15  percent  (RDT&E)  cost 
margins  and  a  90-day  schedule  margin . 
According  to  the  law,  the  PM  was  to 
submit  a  deviation  report: 

...there  is  reasonable  cause  to 
believe  that  the  total  cost  of  com¬ 
pletion  of  the  program  will  be 


more  than  | the  baseline). ..and, 
any  milestone  specified  in  [the 
baseline]  will  not  be  completed  as 
scheduled. 

Subsequent  amendments  to  the  statute 
have  incorporated  the  5  percent  ' 15 
percent  and  90-day  margins.  The  DOD 
amended  baselining  policy  via  the 
DAE  policy  memorandum  to  include 
a  180-day  schedule  margin  because 
such  a  margin  is  much  more  realistic 
and  also  has  the  advantage  of  match¬ 
ing  the  SAR  quarterly  submission 
schedule  criterion.  Once  again,  this 
change  will  necessitate  legislative  relief. 
Ninety-day  slippages  will  still  be 
reported  in  DAES  submittals,  in  ac¬ 
cordance  with  current  legislation. 

Reporting  baseline  deviations  via 
DAES  reports  allows  the  military  ser¬ 
vices  to  abide  by  another  legislative 
requirement — the  program  deviation 
report.  Also  called  for  in  Section  2435, 
this  report  must  be  submitted  by  the 
PM  to  the  Service  Secretary  and  the 
SAE.  After  reviewing  the  subject  pro¬ 
gram,  the  Service  Secretary  must  sub¬ 
mit  a  report  to  the  USD(A).  The 
quarterly  DAES  submittal,  including 
the  PM,  PEO  and  the  SAE  assessment 
of  baseline  performance,  will  allow  the 
military  service  to  report  breaches  and 
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some  outstanding  policy  issues  were 
discussed. 


Summary 

This  article  attempts  to  give  you  a 
broad  overview  of  major  program 
baselining  in  the  Department  of 
Defense.  Areas  covered  are  the  pur¬ 
pose  and  definition  of  baselining;  a 
briet  history  of  baselining  efforts 
within  the  three  military  services;  a 
discussion  of  recent  program  base¬ 
lining,  with  an  emphasis  on  OSD  and 
legislative  initiatives;  and  an  examina¬ 
tion  of  issues  still  to  be  addressed  in  the 
baselining  effort  and  a  review  of  the 
current  status  of  Department  of 
Detense  baselining  effort. 


Conclusions 


Is  baselining  the  answer  to  the 
perennial  problem  of  fluctuating 
budget  authority  levels  and  the  atten¬ 
dant  program  instability  it  causes;  or 
is  baselining  merely  a  buzzword,  a 
catchy  title  for  a  less-than-substantive 
concept  with  reporting  guidelines  bely¬ 
ing  essential  premise?  These  questions 
define  the  central  policy  debate  waged 
within  the  Pentagon  and  on  Capitol 
Hill  for  the  past  18  months. 


Baselining  as  a  management  concept 
and  practice  is  certainly  not  a  new  idea 
within  the  department,  but  one  that 
gained  renewed  emphasis,  especially  in 
the  current  environment  of  fiscal  con¬ 
straint.  Baselining  the  critical  parame¬ 
ters  of  a  program  is  inextricably  linked 
to  the  departmental  goal  of  enhancing 
program  stability  and  the  oft-stated 
objective  of  gaining  effective  control  of 
the  acquisition  process.  Perhaps  it  is 
due  to  having  these  related  but  sepa¬ 
rate  demands  placed  upon  it  that  base¬ 
lining  has  so  often  been  pulled  in  dif¬ 
ferent  philosophical  and  practical 
directions.  These  competing  objectives 
can  be  summarized  succinctly: 
Another  budget  and  management 
reporting  requirement  levied  upon  the 
program  office  merely  for  the  sake  of 
reporting  versus  a  true  and  substantial 
management  commitment  (extending 
across  all  military  service  management 
levels  and  to  OSD)  to  a  specified 
program . 


We  have  seen  that  the  military  ser¬ 
vices  employed  methods  of  baselining 
programs  (major  and  non-major)  for 
several  years  and  the  three  methods 
differ  across  a  range  of  categories.  We 
examined  the  history  behind  the  recent 
resurgence  of  baselining  as  a  depart¬ 
ment-wide  initiative  and  reviewed  the 
specific  recommendations  of  the 
Packard  Commission  and  the  provi¬ 
sions  of  the  baselining  statute.  Also, 
we  reviewed,  in  some  detail,  the  policy 
process  leading  to  enforced  baselining 
for  all  major  programs  in  FSD  or  pro¬ 
duction.  Finally,  the  current  status  of 
the  baselining  effort  was  analyzed  and 
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necessary  future  reviews:  by  stipu¬ 
lating  goals  and  thresholds  for  critical 
program  parameters  at  the  inception  of 
FSD,  the  DAE  is  informing  the  acquisi¬ 
tion  community  of  the  standard  that 
the  program  is  expected  to  meet.  Pro¬ 
ponents  argue  that,  while  attractive  in 
the  abstract,  it  is  practically  infeasible 
to  "fence”  even  a  few  high-priority  pro¬ 
grams  and  that,  given  this  reality,  it 
makes  sense  to  at  least  set  the  standard 
for  program  performance  and  thereby 
illuminate  technical  and  affordability 
issues  when  the  time  comes  for  major 
budget  decisions. 


Detractors  argued  that  baselining  (as 
applied  to  more  than  100  major  pro¬ 
grams  spanning  the  technological  and 
financial  gap  from  radios  tc  fighter  air¬ 
craft,  from  hundreds  of  millions  of 
dollars  to  tens  of  billions  of  dollars)  is 
doomed  to  failure.  It  is  contended  it 
will  not  and  cannot  fulfill  its  primary 
mission  to  control  costs  and  schedules 
and  stabilize  programs.  These  detrac¬ 
tors  view  baselining  as  a  true  contract 
between  senior-level  managers  and  the 
program  manager.  In  the  detractors’ 
opinion,  once  baselined,  a  program 
definition  is  preserved  and  protected 
from  the  vagaries  of  budget  and  policy 
processes.  For  such  a  method  to  be  ef¬ 
fective,  it  must  be  used  sparingly  and 
only  on  the  highest  priority  programs; 
thus,  the  conundrum  presented  by  ap¬ 
plying  the  concept  to  more  than  100 
programs.  Consequently,  in  the  face  of 
this  baselining  policy,  detractors  tend 
to  view  it  as  merely  another  reporting 
requirement. 


Proponents,  on  the  other  hand,  be¬ 
moan  the  lack  of  true  management 
control  in  the  DOD  acquisition  mile¬ 
stone  review  process  and  point  to  the 
short  term  of  Richard  P.  Godwin  as 
Under  Secretary  of  Defense  for  Ac¬ 
quisition,  as  evidence  of  this  trend. 
Baselining  is  seen  as  a  means  to 
strengthen  the  management  effective¬ 
ness  of  the  DAE  in  the  performance  of 
duties.  By  reviewing  and  approving  a 
program  baseline  for  every  major  pro¬ 
gram  as  it  enters  FSD  and  production, 
proponents  contend  the  DAE  is  mak¬ 
ing  the  milestone  review  process  a 
much  more  substantive  examination  of 
a  program’s  true  military  worth  and 
cost  effectiveness.  In  addition,  the 
DAE  is  laying  the  foundation  for  any 


Baselining  policy  will  undoubtedly 
continue  to  be  refined  in  the  future. 
Much  progress  has  been  made  thus  far 
including  clarifying  the  relationship 
between  departmental  policy  and 
legislative  requirements  and  the 
preparation  and  submittal  of  close  to 
100  baseline  documents.  In  what  ap¬ 
pears  to  be  an  era  of  prolonged  fiscal 
constraint,  impervious  to  which  party 
wins  control  of  the  White  House  this 
November,  baselining  will  probably 
continue  to  be  accorded  a  high  level  of 
management  attention.  After  initial 
establishment  of  baselines  for  all  ma¬ 
jor  programs,  the  true  management 
challenge  will  be  the  effective  admin¬ 
istration  of  these  baselines.  This  will 
include  not  only  a  well-articulated 
policy  of  baseline  deviation  reviews 
but  also  a  routine  process  of  reporting 
progress  against  the  baseline  stan¬ 
dards.  Finally,  one  management  chal¬ 
lenge  will  be  adequately  defining  the 
integrity  of  baseline  parameters, 
especially  cost,  as  they  relate  to  the 
PPBS  process.  Dealing  with  this  chal¬ 
lenge  will  highlight  the  longstanding 
debate  as  to  which  management  sys¬ 
tem  predominates  in  defense  planning, 
the  acquisition  milestone  review  pro¬ 
cess  or  the  PPBS  resource  allocation 


process. 
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■:  Continued  front  page  41, 

—  Diagnosing  organizational  problems 
—To  show  M.B.A.  students  the  nature 
of  managerial  work 

—  To  enable  technical  people  to  ex¬ 
perience  managerial  work 

—  Assessment  of  managerial  potential. 

Participation  in  Looking  Glass  cun 
be  the  highlight  of  a  student's  visit  with 
DSMC.  So  far,  DSMC  has  run  the 
simulation  12  times.  The  following 
comments  from  past  participants  are 
typical  of  those  received  on  the  cri¬ 
tique  sheets: 

■-  1  feel  I  was  helped  by  the  entire 
workshop, " 

—  "One  ot  the  best  experiences  at 
DSMC," 


—  "An  excellent  simulation  — very 
realistic,'' 

—  "One  of  the  highlights  at  DSMC," 

—  "Exceptionally  valuable," 

—  Thoroughly  fascinating." 

As  reflected  in  discussions  after  the 
conclusion  of  the  workshop,  the 
simulation  has  been  challenging  and 
fun.  Participants  find  they  have  taken 
stock  of  Aieir  managerial  abilities, 
learned  more  about  the  process  of 
management,  and  how  to  make  it 
work  for  themselves  and  their 
organizations. 

Looking  Glass  is  like  a  mirror.  It 
provides  a  manager  the  opportunity  to 


look  at  personal  managerial  perfor¬ 
mance  and  to  be  perceived  by  other 
Looking  Glass  managers.  Reflections 
provide  greater  self  understanding 
from  which  one  can  make  decisions  to 
change  or  fine  tune  management  style. 
In  a  quest  for  excellence,  this  simula¬ 
tion  helps  participants  understand 
what  Plato  meant  when  he  said, 
"Know  thyself." 


Mr.  Krause  is  a  Professor  of  Educational 
Research,  Education  Research  Team,  at  the 
Defense  Systems  Management  College. 
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he  purpose  of  this  ar- 

'•  tide  is  to  present 
selected  statistical  methods 
which  can  be  applied  in 
establishing  population 
parameters.  These  para¬ 
meters  have  application  in 
analysis  and  development  of 
sustaining  and  corrective  ac¬ 
tions  regarding  trends, 
recognizing  and  dealing  with 
timeliness  and  respon¬ 
siveness  measurements,  and 
obtaining  optimal  informa¬ 
tion  from  statistical  action 
experiments. 

Each  measurement  indicator  presented  to  the  appropriate 
audience  is  the  result  of  the  timely  treatment  of  one  or  more 
established  data  bases  or  parts  (files)  thereof  by  mature, 
readily  available  statistical  analysis  routines.  Output  forms 
include  both  tables  and  charts  or  graphs. 

Multivariate  Methods 

The  analysis  and  interpretation  of  trends  nearly  always 
utilizes  one  or  more  of  the  statistical  techniques  known  col¬ 
lectively  as  "multivariate  methods."  Thus,  the  application 
and  examples  presented  in  this  article  are  introduced  through 
a  brief  tutorial  on  the  subject  of  multivariate  analysis  as  a 
whole. 

Observers  of  any  quantified  process— whether  it  is 
physical,  financial,  social,  or  in  any  other  realm— tend  to 
relate  the  trend  being  studied  to  a  time-interval  scale.  In 
other  words,  we  review  past  data  and  then  forecast  the 
future  status  of  manufacturing,  economic,  or  human  perfor- 
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mance  using  time  units  such 
as  hours,  days,  quarters  or 
years.  While  there  is  no 
harm  in  this  practice,  neither 
is  it  inclusive  of  all  of  the 
useful  dimensions  upon 
which  such  behavior  may  be 
based. 


In  fact,  as  is  frequently  the 
case,  when  time-based  popu¬ 
lations  or  samples  are  quite 
dissimilar  in  size,  conclu¬ 
sions  from  analyses  are 
severely  hampered,  and 
alternative  methods  of 
grouping  should  be  used.  For  example,  in  a  production  en¬ 
vironment  chronological  subgroups  of  equal  size  (e.g.,  5, 
10,  20,  or  even  100)  can  be  identified  and  evaluated.  In 
another  vein,  when  distances  operated  by  a  vehicle  are  of 
interest,  the  scale  of  the  independent  variable  could  be  miles 
or  kilometers. 

A  distinction  must  be  made  between  two  major  topics  in 
the  area  of  multivariate  analysis;  i.e.,  correlation  and  regres¬ 
sion.  Correlation  analysis  is  limited  to  describing  the  direc¬ 
tion  and  degree  of  association  between  and  among  variables 
which  are  considered  to  be  mutually  related  rather  than 
dependent  one  upon  another.  By  definition,  coefficients  of 
correlation  are  limited  in  value  such  that  they  cannot  ex¬ 
ceed  either  negative  or  positive  one,  while  their  squares, 
coefficients  of  determination  (which  are  defined  and  des¬ 
cribed  below),  are  bounded  by  zero  and  one. 

On  the  other  hand,  regression  analysis  is  used  to  estimate 
dependent  variable  values  based  on  given  values  of  one  or 
more  independent  variables.  It  utilizes  the  least-squares 
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method  in  minimizing  the  sum  of  the 
squares  of  the  vertical  distances  of  all 
the  sample  points  from  the  resulting 
regression  line,  a  graphic  pattern  which 
is  the  line  of  best  fit  to  the  sample 
points.  Regression  line  coefficients  (in¬ 
tercepts  and  slopes)  are  limited  in  value 
by  negative  and  positive  infinity. 

Assumptions  and  Conventions 

To  optimally  apply  standard 
multivariate  methods  such  as  regres¬ 
sion  and  correlation  to  the  analysis  of 
trends  in  manufacturing  yields  and 
defect  defective  rates,  the  following 
assumptions  must  be  made:  (1)  the 
"collection"  of  elements  being  tracked 
is  a  sample  from  a  larger  population, 
lot  or  batch;  (2)  the  sample,  thus  de¬ 
fined,  has  been  selected  randomly,  or 
at  least  under  conditions  that  nssure 
representativeness;  and  (3)  the  sample 
is  sufficiently  large  to  expect  it  to 
behave  "normally"  according  to  the 
statistical  "Central  Limit  Theorem." 
Forms  of  the  correlation  model  in¬ 
clude,  but  are  not  limited  to; 

—Simple.  This  form  can  use  only  two 
variables. 

—  Multiple .  This  model  is  based  on  the 
relationship  between  a  single  variable 
and  a  collection  of  two  or  more  other 
variables. 

—  Partial.  This  technique  is  used  to 
assess  the  relationship  between  two 
variables,  excluding  the  influence  of 
one  or  more  additional  variables. 

—  Rank.  This  approach  is  used  when 
the  data  are  of  the  ordinal,  not  inter¬ 
val  nor  ratio,  level  of  measurement. 
Examples  include:  the  Spearman  "rho" 
and  Kendal  ”tau”  methods. 


A 


mong. 


but  not  exhaustive  of,  the 


varieties  of  regression  analysis  applied 
to  scientific,  economic  and  social  data 
are: 


—  Simple  linear.  This  is  a  straight  line 
relationship  between  two  variables. 

Multiple.  This  version  makes  use  of 
two  or  more  independent  variables. 

Stepwise  multiple.  This  approach 
collects  or  eliminates  independent 
variables  in  the  order  of  their  relative 
(ontribution  to  the  estimate  of  the 
dependent  variable. 

\ .'’’-linear  'curvilinear  or 
polynomial1  This  technique 

establishes  the  relationship  between 
two  variable  forms  Graphically ,  it  is 

l’n  »e: cun  Manager 


a  curve  rather  than  a  straight  line  and, 
therefore,  higher  powers  (second, 
third,  etc.)  of  the  independent  variable 
are  found  in  the  model/equation. 
—Discriminant  analysis.  This  method 
uses  simple  or  multiple  regression  in 
which  the  dependent  variable  is 
categorized  into  a  small  number  of 
groups  rather  than  measured  along  a 
scale. 

—  Time  series  analysis.  This  can  take 
either  a  linear  or  non-linear  form,  but 
with  the  distinguishing  feature  that  the 
independent  variable  is  measured 
along  a  time  scale  or  its  equivalent. 

A  better  single  measure  of  bivariate 
(simple)  or  mutivariate  association 
than  the  coefficient  of  correlation  (r) 
is  its  square,  known  as  the  coefficient 
of  determination  (r-squared).  The  lat¬ 
ter  statistic  indicates  what  proportion 
of  the  dispersion  or  variance  in  one 
variable  is  explained  by  the  dispersion 
in  the  other  variable.  An  "r-squared" 
of  0.25  (i.e.,  r  =  either  +0.5  or  —0.5) 
indicates  that  25  percent  of  the  spread 
in  one  variable  is  accounted  for  by  the 
spread,  either  plus  or  minus,  in  the 
other;  conversely,  when  r  =  ±  0.8, 
then  r-squared  =  0.64  is  intepreted  to 
mean  that  64  percent  is  likewise 
explained. 


Interpretation 


In  the  interpretation  ot  trends,  linear 
and  otherwise,  one  must  exercise  great 
care  in  attempting  to  estimate  the 


dependent  variable  by  extrapolation 
very  far  beyond  the  range  of  the  sam¬ 
ple  data  from  which  the  model  was 
built.  A  crude,  but  appropriate,  rule- 
of-thumb  might  be  that  the  number  of 
time  periods  or  other  points  ex¬ 
trapolated  beyond  the  sample  points 
should  not  exceed  one-fourth  of  the 
number  of  those  sample  members.  All 
other  factors  being  equal,  the  larger  the 
ratio  between  historical  and  forecasted 
values,  the  more  reliable  the  forecast. 


Also,  multiple  regression  analysis 
should  pay  heed  to  the  existence  of  any 
multicollinearity;  i.e.,  a  significant  cor¬ 
relation,  either  positive  or  negative, 
between  one  or  more  pairs  of  indepen¬ 
dent  variables. 


To  aid  in  the  interpretation  of  trends 
over  time  and  in  other  multivariate 
analyses,  a  number  of  statistical  and 
graphical  outputs  should  be  con¬ 
sidered;  among  them: 


Extreme  Values  Among  Samples 
The  simplest  and  most  popular 
method  of  testing  a  suspected  extreme 
value  uses  the  ratio  of  two  ranges;  i.e., 
the  distance  of  the  suspected  outlier 
from  one  of  its  near  neighbors  divided 
by  its  distance  from  one  of  the  furthest 
sample  values,  Sound  technical  and 
managerial  judgment  must  override 
the  performance  of  numbers  in 
assessing  possible  extreme  values. 


If  one  or  more  high  and/or  low 
values  is/are  rejected  at  a  chosen  risk 
level  (alpha),  the  appropriate  descrip¬ 
tive  measures  are  then  conventionally 
recalculated,  as  are  the  test  statistics 
concerning  hypotheses;  e.g.,  F,  t,  r, 
and  the  regression  coefficients. 
However,  one  should  not  automatical¬ 
ly  eliminate  an  outlier  since  it  may 
yield  information  that  the  other 
members  of  the  sample  cannot. 


—  Coefficient  of  determination 
(r-squared).  As  noted  earlier,  this  is  the 
best  indicator  of  bivariate  or 
multivariate  association.  It  measures 
the  proportion  of  variation  which  can 
be  explained  by  the  variation  in  the 
other.  In  general,  an  r-squared  greater 
than  0.8  is  considered  a  good  fit,  from 
0.5  to  0.8  a  moderate  fit,  and  0.25  to 
0.5  only  fair. 

—Variance  ratio  (F).  This  is  the 
variance  due  to  the  regression  relation¬ 
ship  divided  by  the  variance  due  to  er¬ 
ror  (the  composition  of  the  sample).  It 
indicates  whether  and  to  what  extent 
a  significant  relationship  exists  be¬ 
tween  the  dependent  variable  and  the 
independent  variable  or  set  of  indepen¬ 
dent  variables. 

— Regression  slopes/ coefficients  (b), 
their  standard  errors  (Sb),  and  the  ratio 
of  "b"  to  "Sb''  (t).  In  general,  the 
greater  the  value  of  "t,”  the  more 
significant  the  slope;  i.e.,  the  less 
chance  that  a  line  of  such  a  slope  could 
have  been  obtained  merely  by  accident 
while  sampling. 

— Standard  error  of  the  estimate  (Se). 
This  is  the  standard  deviation  of  the 
distribution  of  the  values  of  y  for  a 
given  value  of  x. 

—  Control  limits.  These  are  used  for 
estimating  the  dependent  variable  (y) 
and  are  determined  using  the  relation¬ 
ship,  y  ±  (K)  (Se).  It  is  common,  but 
not  necessarily  recommended,  to  use 
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K  =  3  standard  errors  in  establishing 
such  limits  so  as  to  be  virtually  certain 
(actualy  99.73  percent)  to  bracket  nor¬ 
mally  distributed  values  of  y.  From  a 
trend  warning  standpoint,  more  useful 
limits  might  be  ±  1.96Se,  ±  1.645Se, 
or  ±  l.OOSe.  These  are  equivalent  to 
95  percent,  90  percent,  and  68  percent 
assurance  (confidence),  respectively. 

Precautions 

Frequently,  it  is  necessary  to  com¬ 
pare  the  behavior  of  a  process  or  a  pro¬ 
duct  at  two  different  life  stages;  e.g., 
yields  for  two  successive  tests,  "before'' 
and  after.  This  is  to  say  that  not  only 
is  each  of  the  trends  analyzed  and  in¬ 
terpreted,  but  the  two  patterns  are 
compared  and  contrasted  with  each 
other. 


Although  Mark  Twain  is  not 
remembered  as  a  statistician,  he  once 
noted  that  if  the  linear  drying  out  of 
the  lower  Mississippi  River  continued 
as  it  had  during  the  last  century,  the 
river  would  disappear  altogether  in  the 
mathematically  foreseeable  future. 
There  are  many  such  dangers  of  ex¬ 
trapolation  in  the  real  world. 
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Not  all  trends  can  be  described  ac¬ 
curately  with  a  straight  line;  neither 
can  all  regressions  be  fitted  best  unless 
the  non-linear  models  are  also  con¬ 
sidered.  Probably  the  best  way  to  test 
for  non-linearity  is  to  fit  the  regression 
by  straight  line  and  then  by  one  or 
more  curvilinear  relationships.  If  one 
of  the  latter  cases  has  a  higher  coeffi¬ 
cient  of  determination,  then  it  can  be 
expected  to  be  more  appropriate.  The 
specific  application  will  dicfate 
whether  or  not  the  non-linear  model  is 
useful.  In  some  cases  more  of  the  varia¬ 
tion  in  the  dependent  variable  could  be 
accounted  for  by  the  non-linear  model, 
but  it  might  not  be  practical  to  use  in 
any  prediction.  There  is  frequently  a 
trade-off  between  a  more  simplified 
model  and  a  better  statistical  fit. 
Usually,  the  latter  implies  collecting 
more  data  at  a  cost  that  must  be 
weighed  against  benefits. 


The  "behavior"  of  numbers  has 
another  serious  drawback  in  its  lack  of 
parallelism  with  things  physical,  social 
and  economic.  Regression  coefficients 
and  the  equations  or  models  built  from 
them  are,  as  noted  earlier,  patterns  or 
paths  of  best  fit  through  existing  data 
points. 


In  applying  regression  techniques, 
the  first  step  is  usually  to  plot  the 
variables  as  a  scatter  diagram.  A 
working  knowledge  of  the  series  one 
is  using  is  necessary  and  should  be  of 
value  in  reaching  a  decision.  Visual  in¬ 
spection  and  judgment  are  vital.  There 
is  no  substitute  for  a  sound  knowledge 
of  the  data  and  good  common  sense  in 
the  application  of  statistical  methods 
to  any  problem. 


If  the  physical  or  mental  growth  pat¬ 
tern  of  a  child  is  plotted  for  the  early 
years,  it  is  likely  to  take  on  a  second 
degree  form  with  early  acceleration 
slowing,  but  with  progress  still  occur¬ 
ring,  even  after  some  years.  Projecting 
the  mathematical  equation  which  best 
fits  the  existing  points  beyond  the  pre¬ 
sent  ( i.e. .  extrapolating  the  patterns  to 
later  years)  would  probably  show 
downturns  in  the  near-  to  mid-term 
future.  In  other  words,  the  child  would 
be  predicted  to  become  smaller,  less 
skilled  or  less  developed,  and  so  on.  Of 
course,  that  is  an  illogical  forecast  as 
would  be  its  counterpart  in  quality- 
related  trends  such  as  reliability 
growth,  manufacturing  yield,  and 
defect  reduction.  Sound  technological 
and  managerial  judgment  based  on  ad¬ 
ditional  information  must  override  the 
performance  of  numbers. 


reliability  may  be  measured  as  mean 
miles,  perhaps  thousands,  or  as  the 
probability  of  success.  The  last  scale  is 
limited  to  values  of  zero  through  one, 
but  it  is  anticipated  that  products  and 
processes  perform  toward  the  high  end 
of  that  segment. 

Scrap  and  rework  figures,  as  well  as 
many  other  cost  and  value  indicators, 
are  expressed  as  dollar  totals. 
Deliveries  of  hardware,  software,  data, 
etc.,  are  reported  as  raw  frequencies 
and/or  percent  conformance  to 
schedule.  Current  period  as  well  as 
cumulative  information  is  frequently 
prioritized  by  its  recency  to  make  its 
role  more  meaningful.  Ratio  informa¬ 
tion  is  also  produced  to  meet  manage¬ 
ment's  needs;  e.g.,  touch,  direct,  super¬ 
visory,  and  quality  support  labor. 
Time  delays  related  to  material  pro¬ 
curement,  handling,  and  disposition 
are  found  in  management  reports; 
usually  expressed  in  time  periods 
(hours,  days,  and  weeks). 


Indicator  Ranges 

Typical  ranges  of  data  for  a 
proposed  set  of  management  indicators 
tend  to  fit  into  predetermined  clusters. 
For  example,  such  items  as  manufac¬ 
turing  and  field  yields,  both 
theoretically  and  occasionally  in  prac¬ 
tice.  are  bounded  by  0  and  100  percent. 
Rates  of  engineering  changes, 
absences,  return  on  investment,  turn¬ 
over,  overtime,  cycle  times,  etc.,  are 
also  percentages  but  tend  toward  a 
limit  of  zero. 


Conclusion 

Data  management  can  be  con¬ 
siderably  enhanced  by  the  intelligent 
and  practical  application  of  statistical 
methodologies.  This  article  has 
provided  a  brief  overview  of  the  vast 
array  of  quantitative  and  graphical 
techniques  available  for  use  in  making 
better  use  of  our  extensive  data  bases. 
Interested  readers  are  encouraged  to 
refer  to  the  list  of  references  following 
this  article. 
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or  every  Si  billion 
the  Air  Force  spends 
for  the  acquisition  of  a  ma¬ 
jor  weapon  system,  $3-5 
billion  are  typically  spent 
during  its  lifetime  to  support 
it.  A  significant  part  of  the 
logistics  system  is  the  equip¬ 
ment  required  for  weapon 
system  checkout,  main¬ 
tenance,  and  repair.  This 

equipment  ranges  in  complexity  from  relatively  simple 
wrenches  to  complex  computer-controlled  test  benches.  It 
can  be  located  on  the  flightline,  in  a  base  repair  shop,  or 
at  a  depot.  This  wide  range  of  equipment  is  generally  re¬ 
ferred  to  as  support  equipment  (SE). 


tion  depends  on  the  weapon 
system's  final  design  and 
specific  details  of  the 
maintenance  approach.  To 
avoid  proliferation  of  in¬ 
dividual  items  of  equipment 
which  perform  essentially 
the  same  function,  the 
military  requires  that  ex¬ 
isting  support  equipment  be 
evaluated  to  determine  if  one 
could  satisfy  the  requirement.  The  Air  Force  increasingly 
is  "breaking  out"  the  purchase  of  high-dollar  value  support 
equipment  and  items  available  in  the  commercial 
marketplace.  This  increases  the  management  workload  on 
the  acquisition  agency. 


For  a  major  aeronautical  weapon  system  involving  many 
weapon  platforms,  literally  thousands  of  line  items  of  sup¬ 
port  equipment  are  required,  generally  at  the  three  levels 
of  maintenance  mentioned  above;  flight  line,  intermediate 
shop  or  base  level,  and  depot  level. 


The  cost  of  support  equipment  can  approach,  or  exceed, 
$1  billion  during  the  weapon  system's  life  cycle.  The 
magnitude  of  this  budget  is  not  surprising  if  one  considers, 
for  example,  that  fighter  aircraft  are  deployed  at  many  bases 
throughout  the  world  and  have  many  complex  subsystems 
(avionics,  jet  engines,  weapons  handling,  etc.)  which  must 
be  supported  to  sustain  high  rates  of  readiness. 


Normally,  the  support  equipment  can  be  finalized  only 
after  everything  else  is  designed,  since  its  final  configura¬ 


Many  improvements  have  been  made  to  the  SE  acquisi¬ 
tion  process;  e.g.,  updating  and  computerizing  the  data  base 
of  existing  SE  (MIL-HDBK-300).  But  SE  acquisition,  from 
design  to  approval  to  contracting  to  manufacture,  remains 
a  labor-intensive  process.  Often,  it  operates  under  vpry  real 
time  constraints.  The  Air  Force  is  developing  a  Support 
Equipment  Master  Plan  (SEMP)  as  a  roadmap  for  SE  ac¬ 
quisition.  This  paper  concerns  a  concept  for  a  Support 
Equipment  Decision  Support  System  (SEDSS)  which  could 
provide  automated  tools  to  suppor*  the  implementation  of 
the  SEMP.  It  could  reduce  the  need  for  manpower-intensive 
activities  required  during  the  SE  acquisition  process  by  pro¬ 
viding  contractors  with  tools  that  could  be  used  interactively 
during  design  and  manufacturing  planning,  and  by  the 
government  for  assuring  application  of  appropriate  design 
methodology,  aggregating  orders  of  similar  types  of  SE,  etc. 
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The  design  process  for  a  weapon 
system  usually  employs  at  least  these 
four  techniques  to  narrow  the  choices 
of  design  alternatives: 

—  Modify  design  constraints 

—  Select  final  design  implementation 
from  among  alternatives 

—  Employ  standard  hardware  com¬ 
ponents  to  greatest  extent  possible 

—  Describe  standard  hardware  com¬ 
ponents  by  key  functional  character¬ 
istics. 

These  same  ideas  can  be  incor¬ 
porated  into  the  SEDSS.  For  instance, 
if  a  weapon  system  designer  was  aware 
early  enough  of  implications  of  his 
design  on  cost  and  complexity  of  the 
SE,  he  could  modify  the  design  ap¬ 
proach  somewhat  or  alter  functions 
that  the  SE  was  to  accomplish,  so  that 
it  could  be  simplified.  An  SE  design 
engineer  might  modify  specifications 
for  an  SE  item  if  he  was  readily  aware 
of  the  cost  of  each  level  of  functionality 
of  the  SE  and  whether  SE  already  ex¬ 
isted,  either  slightly  more  capable  or 
less  capable  than  specified. 

Issues 

There  are  many  management 
oriented  barriers  to  developing  a 
SEDSS.  These  include  the  high  initial 
costs  of  developing  and  populating 
data  bases,  overcoming  reluctance  of 
designers  to  have  more  constraints 
added  to  their  menu,  establishing  a 
suitable  way  to  measure  the  extent  of 
SE  reuse,  measuii-.g  productivity  in¬ 
crease  due  to  application  of  an  SEDSS, 
and  so  on.  Answers  to  these  issues  are 
influenced  to  a  large  extent  by  the 
technical  solutions  to  the  SEDSS.  Cen¬ 
tral  to  the  SEDSS  concept  are  readily 
accessible  and  usable  data  bases.  Thus, 
management  and  organization  of  these 
data  bases  are  the  most  significant 
issues  to  be  addressed. 

The  establishment  of  a  complete 
library,  to  serve  all  users,  containing 
all  SE  with  all  of  its  pertinent  char¬ 
acteristics  extending  beyond  what  is 
currently  available  in  MIL-HDBK-300, 
"Technical  Information  File  of  Support 
Equipment,'"  would  be  a  substantial 
undertaking.  It  may  not  be  well  ad¬ 
vised  for  some  time.  A  complex  cata¬ 
loging  and  retrieval  system  would  be 
necessary  to  serve  all  users.  It  would 
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be  costly  to  develop  and  would  require 
a  long  development  cycle.  A  better  ap¬ 
proach  is  to  narrow  the  domain  suffi¬ 
ciently  so  that  data  bases  do  not 
become  large  and  unwieldly,  but  large 
enough  to  incorporate  a  meaningful 
suite  of  SE. 

Such  a  library  could  be  implemented 
at  different  levels.  A  Level  1  library 
may  be  used  at  a  particular  location 
within  a  specific  domain.  A  Level  2 
library  could  encompass  several  loca¬ 
tions,  perhaps  still  belonging  to  the 
same  organization,  within  the  same 
domain.  A  Level  3  library  might  in¬ 
clude  several  Level  2  libraries  and, 
thus,  have  a  broadened  domain,  and 
so  on.  In  this  way,  the  library  system, 
(i.e.,  data  bases)  would  be  constructed 
incrementally  while  still  providing 
near-term  benefits.  This  approach  re¬ 
quires  a  top-down  architecture  of  the 
library  so  that  various  levels  could  be 
readily  integrated  later. 

Populating  the  library  entails  ap¬ 
plication  of  well-defined  guidelines  to 
select  data  elements  for  the  library. 
This  process  inevitably  requires  trade¬ 
offs.  For  instance,  large  and  more  com¬ 
plex  items  of  SE  have  a  greater  reuse 
payoff  than  smaller  and  less  complex 
ones,  but  the  domain  of  the  applica¬ 
tion  narrows  appreciably  and,  thus, 
the  chance  of  reuse  is  reduced.  Some 
are  too  specialized,  too  large,  or  too 
small.  Developing  the  boundaries  of 
the  SE  before  the  data  bases  are  de¬ 
signed  is  a  significant  issue. 

Component  descriptions  are 
necessary  to  encode  the  key  informa¬ 
tion  represented  by  the  SE.  These 
descriptors  must  be  complete  enough 
so  that  the  library  search  will  not  iden¬ 
tify  a  large  number  of  SE  items  which 
are  not  pertinent,  but  will  not  require 
an  excessively  long  descriptor  list 
either.  A  complete  description  must  in¬ 
clude  information  at  all  levels  of 
abstraction  available,  from  re¬ 
quirements  and  specifications  at  the 
highest  level  to  engineering  drawings 
and  detailed  cost  information  at  the 
lowest  level.  Users  of  the  system 
should  not  have  to  spend  excessive 
time  inspecting  and  evaluating  a  can¬ 
didate  item  of  SE. 

A  standard  vocabulary  should  be 
established  to  describe  various  SE 
elements.  An  approach  utilizing  the 


group  technology  philosophy  has 
worked  well  in  manufacturing.  For  in¬ 
stance,  a  machined  part  can  be  des¬ 
cribed  by  a  series  of  digits. 

A  library  scheme  is  the  cornerstone 
of  SE  reuse.  The  classification  ap¬ 
proach  is  the  crucial  factor  in  the  ef¬ 
fectiveness  of  the  library.  Data 
retrieval  systems  are  naturally  deter¬ 
ministic.  On  the  other  hand,  document 
retrieval  systems,  based  on  abstract 
descriptions,  tend  to  be  probabilistic 
since  the  user  cannot  be  assured  that 
a  given  document  will  satisfy  a  request 
until  it  is  examined.  The  SE  retrieval 
falls  somewhere  between  those  two  ex¬ 
tremes.  If  the  desired  SE  is  described 
specifically,  the  retrieval  process  ap¬ 
proaches  the  deterministic  end  of  the 
spectrum;  for  instance,  "retrieve  all 
rigid  horoscopes  10  inches  in  length.” 
But  if  the  features  are  described  more 
abstractly,  the  retrieval  process  ap¬ 
proaches  the  probabilistic  end  of  the 
spectrum;  for  example,  "retrieve  all 
horoscopes  capable  of  inspecting  a 
gear  about  10  inches  inside  a  gear  box, 
and  which  can  sustain  some  amount  of 
impact  loading." 

A  probabilistic  search  increases  the 
chance  that  a  usable  item  of  SE  will  be 
retrieved  so  long  as  the  search  at¬ 
tributes  are  relevant  to  the  user’s  re¬ 
quest  and  are  available  as  coded  at¬ 
tributes  of  the  items  in  the  collections. 
However,  the  user  must  be  able  to  easi¬ 
ly  understand  and  evaluate  the  re¬ 
trieved  SE.  An  SE  library  should  be 
capable  of  providing  the  user  with  dif¬ 
ferent  levels  of  documentation 
matched  to  the  user's  interest. 

Once  an  item  is  selected,  the  user 
could  either  use  the  item  as  is  or 
modify  it  to  suit  the  new  application. 
Modification  could  involve  specifica¬ 
tion  of  the  item,  and  physical  changes 
to  the  SE. 

From  the  above  discussion,  these 
components  are  necessary  to  provide 
an  automated  system  geared  to  the  use 
of  existing  SE: 

—  Library  of  SE  with  pointers  to  de¬ 
tailed  documentation,  such  as  engi¬ 
neering  drawings,  specifications,  etc., 
which  reside  in  a  data  base. 

—  Classification  scheme  that  provides 
framework  for  placing  items  in  the 
library,  and  for  building  queries  and 
conducting  SE  retrieval  searches. 
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—  Decision  support  systems  which 
facilitate  user  access  to  library  infor¬ 
mation,  and  assist  in  selection  process. 
The  system  should  guide  user  through 
the  classification  scheme  to  choose  the 
most  appropriate  terms  for  the  query. 
The  system  should  apply  a  logical  set 
of  rules  to  rank  order  the  retrieved 
items  of  SE. 


Decision  Support  Systems 


Computers  are  effective  in  sup¬ 
porting  structured  decision  processes, 
whereas  human  interaction  with  the 
computer  is  essential  in  dealing  with 
semi-structured  decision  processes. 
Two  essential  features  of  a  DSS  are  ex- 
tendability  and  user  friendliness.  These 
are  important  for  the  following 
reasons: 


—The  DSS  must  be  capable  of  being 
developed  and  tested  incrementally 
once  the  overall  system  architecture  is 
defined;  i.e.,  top-down  architecture 
with  bottoms-up  implementation. 

—The  DSS  must  be  capable  of  being 
adapted  to  many  different  aerospace 
environments  since  users  will  include 
a  number  of  system  program  offices, 
depots,  and  the  aerospace  industry. 
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—The  DSS  must  support  a  number  of 
users,  ranging  from  SE  managers,  to 
design  engineers,  to  manufacturing 
engineers,  cost  estimators,  etc. 


—User  friendliness  is  essential  because 
the  DSS  will  never  be  used  to  its  poten¬ 
tial,  regardless  of  its  capability,  if  users 
find  it  difficult  to  understand  and  to 


use. 


Decision  Support  Systems  (DSS) 
provide  computer  based  support  for 
decision-makers  dealing  with  struc¬ 
tured  and  semi-structured  problems  at 
organizational  levels  in  all  phases  of 
design,  manufacturing,  scheduling, 
deployment,  and  follow-on  support. 
Decision  processes  predictable  and  well 
understood  are  referred  to  as  struc¬ 
tured.  These  processes  are  easily 
automated  and  historically  have  been 
the  major  focus  on  computerized  ap¬ 
plications.  Design  analysis  and  status 
reports  are  typical  examples  of  struc¬ 
tured  decision  processes. 


Development  Cycle 


A  rigorous  development  process 
must  be  followed  to  assure  a  computer- 
based  system  meets  needs  of  users,  in 
a  way  that  makes  the  system  fairly 
easy  to  use  and  maintain.  The  life  cy¬ 
cle  of  a  system  can  be  considered  to  be 
composed  of  these  phases: 


Intuitive  decision  processes  are  re¬ 
ferred  to  as  unstructured.  They  are 
naturally  difficult  to  characterize  and 
cannot  be  completely  described 
because  they  are  not  well  understood 
in  advance.  Those  decision  processes 
which  follow  logical  rules  but  which 
cannot  be  completely  defined  are 
called  semi-structured.  Cost/design 
feature  trade  studies  and  detailed  job 
shop  scheduling  in  manufacturing  are 
examples  of  semi-structured  decision 
processes. 


—Needs  analysis 
— Requirements  definition 
— Preliminary  design 
—Detailed  design 

—Construction  and  verification  testing 
—Integration  and  validation  testing 
—Implementation  and  user  acceptance 
—Maintenance  and  support. 

Proceeding  step-by-step  through  the 
life  cycle  will  help  ensure  the  com¬ 
pleted  system  performs  as  expected. 
The  process  can  be  lengthy  and  expen¬ 
sive.  Software  development  costs  can 
be  minimized  and  risks  reduced  by 
building  a  rapid  prototype  system 
which  uses  software  modules  easily 
adapted  from  existing  software  already 
in  use  in  other  applications,  such  as 
Computer  Aided  Design  and  Com¬ 
puter  Aided  Manufacturing 
(CAD/CAM).  Such  an  approach  re¬ 
quires  building  a  comprehensive  top- 
down  architecture,  not  only  to  assure 
that  the  users'  requirements  are  being 
adequately  supported  but  to  allow  fo* 
the  efficient  adaptation  of  existing  soft¬ 
ware.  The  Needs  Analysis  and  Re¬ 
quirements  Definition  phases  are  par¬ 
ticularly  important. 


Architecture 
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ware  systems  absolutely  require  the 
understanding  and  management  of 
complexity.  An  architecture  not  only 
helps  the  user  develop  requirements, 
but  can  assist  system  designers  in  ad¬ 
dressing  such  issues  as: 

— How  should  the  large  system  be 
broken  into  modules? 

—What  information  should  be  ex¬ 
changed  among  modules? 

— Can  an  existing  software  module  be 
slightly  modified  to  serve  in  the  new 
application? 

Interface  definition,  ambiguity 
resolution,  management  visibility,  and 
constancy  of  assumptions  are  essential 
for  the  design  of  efficient  software 
systems. 


Our  experiences  indicate  the  Air 
Force  ICAM  (Integrated  Computer 
Aided  Manufacturing)  Definition 
(IDEF)  methodologies  are  useful  in 
defining  the  system  architecture.  The 
first  tool,  IDEFO,  is  known  as  the 
Functional  Model.  It  is  essentially  com¬ 
posed  of  a  set  of  modeling  principals, 
information  gathering  procedures,  and 
graphic  notations.  Graphic  notations 
include  a  Node  Tree  which  depicts  the 
hierarchical  relationship  between  func¬ 
tions,  and  Input/Output-type  dia¬ 
grams  which  display  relationships  be¬ 
tween  functions  on  the  Node  Tree.  It 
is  a  robust  tool  and  has  been  used  suc¬ 
cessfully  for  many  applications  in  ad¬ 
dition  to  manufacturing,  such  as  by  the 
Department  of  Defense  study  group  on 
Computer  Aided  Logistics  Support 
(CALS). 


A  crucial  element  in  developing  a 
useful  DSS  lies  in  a  properly  con¬ 
structed  architecture.  The  system  ar¬ 
chitecture  becomes  the  framework 
which  explicitly  defines  fundamental 
relationships  between  elements  of  the 
system,  such  as:  functional  interfaces, 
identification  of  common,  shared,  and 
discrete  information;  and  the  dynamic 
interaction  of  resources.  Large  soft- 


The  second  systems  engineering  tool 
is  IDEFl,  the  Information  Model.  This 
model  captures  the  classification  and 
relationships  between  information 
used  by  the  functions  described  in  the 
IDEFO  model.  It  consists  of  entity 
classes  (real  and  conceptual  objects  and 
data),  attribute  classes  (properties  or 
characteristics  possessed  by  an  entity 
class),  and  the  relationship  between 
two  or  more  classes.  Extensive  use  has 
been  made  of  IDEFl  in  the  develop¬ 
ment  of  data  bases. 


The  IDEF2,  the  Dynamics  Model, 
captures  the  behavior  of  functions  in¬ 
teracting  with  the  information  over  a 
period  of  time  so  that  meaningful 
measures  of  performance  can  be  ob¬ 
tained.  This  simulation  capability 
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AO  Provide 
Logistics 
Support 


A1  Perform  Log. 
Management 


A2  Influence 
Design/ 
Modif. 


A3  Provide  Log. 
Resources 


All  Provide  Config.  Management 
A12  Provide  Cost  &  Sched.  Control 
A13  Manage  Support  Resources 


A21  Provide  Design  Guidance 

A22  Perform  Allocations 

A23  Perform  Equipment  Design 

A24  Perform  Analyses 

A25  Support  Trades 

A26  Demonstrate  and  Approve 


A31  Provide  Contractor  Field  Support 
A32  Provide  Training 

A33  Prepare  Maintenance  &  Operator  Data 
A 34  Perform  Test  and  Evaluation 
A35  Perform  Manufacture 
A36  Provide  Logistics  Systems 


facilitates  the  construct  of  large,  in¬ 
tegrated  computer-based  systems. 

These  IDEF  models  can  represent  the 
logical  architecture  of  the  system  being 
modeled.  They  provide  an  efficient 
framework  in  which  the  information 
gathered  during  the  Needs  Analysis 
phase  of  the  program  can  be  organized 
and  analyzed. 

Needs  Analysis 

Extracting  the  functional  specifica¬ 
tion  from  the  user  is  often  a  major 
challenge.  The  user  rarely  knows  ex¬ 
act  requirements.  A  fundamental  prob¬ 
lem  of  requirements  definition  is  cap¬ 
turing  a  "view"  of  the  requirements 
and  transposing  it  to  a  medium  that 
can  be  clearly  communciated  and  ef¬ 
fectively  analyzed.  A  primary  goal  of 
requirements  analysis  is  creation  and 
documentation  of  an  understanding  of 
the  requirements  by  all  participants. 
Data  from  the  development  of  large 
scale  computer  systems  indicate  that 
analysis  and  design  errors  are,  by  far, 
the  more  costly  and  crucial  types  of  er¬ 
rors;  these  typically  are  not  detected 
until  late  in  the  life  cycle  when  the  cost 
to  fix  them  can  be  as  much  as  100  times 
the  cost  of  fixing  them  during  the  re¬ 
quirements  analysis  phase.  It  has  been 
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estimated  that  for  some  large  systems, 
the  correction  of  fundamental  design 
errors  over  the  life  cycle  accounts  for 
as  much  as  50  percent  of  the  life-cycle 
cost.  The  IDEFO,  together  with  rapid 
prototyping  of  the  system,  can 
enhance  the  user's  ability  to  com¬ 
municate  requirements  to  the 
developer. 

The  proper  introduction  of  support 
equipment  into  the  Air  Force  inventory 
requires  careful  interaction  between 
the  contractor  and  the  government 
during  two  interrelated  processes:  the 
Integrated  Logistics  System  (1LS)  and 
the  Support  Equipment  Recommenda¬ 
tion  Data  (SERD)  procedure.  The  ILS 
is  the  process  of  integrating  support 
considerations  into  system  design, 
developing  and  acquiring  support 
elements,  and  providing  required  sup¬ 
port  during  the  system  operational 
phase.  The  SERD  process,  actually  a 
subset  of  ILS,  is  a  formal  procedure  by 
which  the  Department  of  Defense 
reviews  contractor  recommendations 
for  SE  and  determines  types  and  quan¬ 
tities  of  equipment  to  be  purchased. 

Contractors  provide  three  important 
functions  during  the  SE  acquisition  life 
cycle: 


—Management  of  support  equipment 
acquisition  process 
—Technical  interaction  with  weapon 
system  designers 

— Provision  of  logistics  resources. 

Each  of  these  activities  can  be  fur¬ 
ther  broken  into  subactivities.  Figure 
1  is  a  node  tree  depicting  the  activity 
hierarchy  for  the  contractor's  role.  It 
is  depicted  in  one  of  the  IDEFO  for¬ 
mats.  An  IDEFO  model  should  start 
with  a  declaration  of  the  purpose  of  the 
model,  the  explicit  viewpoint  taken 
(e.g.,  user  perspective,  system 
developer  point  of  view,  etc.),  and 
context  of  model.  This  minimizes  am¬ 
biguities  and  facilitates  reconciliation 
of  different  perceptions.  As  shown  in 
Figure  1,  the  principal  activity  being 
modeled  is  labeled  AO.  It  can  be  fur¬ 
ther  broken  down,  or  decomposed,  in¬ 
to  as  many  as  six  activities,  A1  through 
A6.  Likewise,  A1  can  be  decomposed 
into  All  to  A16;  All  can  be  broken 
down  into  Alll  to  A116,  etc.  Of 
course,  an  activity  need  not  be  decom¬ 
posed  into  6  activities  if  fewer  activities 
are  sufficient.  An  activity  is  described 
by  an  action  verb  with  an  object. 

Now,  each  activity  generally  has  in¬ 
formation  input  into  it,  with  output 
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from  it.  The  activity,  or  function, 
changes  the  input  information  into  the 
output  information.  The  graphical 
depiction  of  the  interrelationship  of  ac¬ 
tivities,  inputs,  and  outputs  constitute 
another  level  of  the  IDEFO  diagram, 
such  as  shown  in  Figure  2.  By  conven¬ 
tion,  the  Inputs  are  shown  entering  the 
activity  box  from  the  left,  and  the  out¬ 
put  exiting  the  box  to  the  right.  Also, 
every  activity  must  have  a  control 
which  serves  as  the  executive.  Controls 
are  the  rules,  performance  criteria,  and 
evaluation  data  which  direct  an 
activity  in  the  accomplishment  of  its 
mission.  Controls  are  shown  entering 
the  activity  box  from  the  top. 

Activities  can  accomplish  their  mis¬ 
sion  through  the  application  of 
resources.  If  it  is  useful  to  indicate  the 
mechanisms  on  the  IDEFO  model,  they 
are  shown  entering  the  activity  box 
from  the  bottom.  For  example,  a 
mechanism  could  be  a  particular  soft¬ 
ware  package. 

An  important  feature  of  IDEFO 
diagrams  is  that  they  gradually  in¬ 
troduce  greater  and  greater  levels  of 
detail  through  graphical  representa¬ 
tion.  This  enhances  communication  by 
providing  a  well-bounded  topic  in  an 
easily  understandable  format. 


Government  personnel  perform 
some  activities  that  parallel  those  of 
the  contractor,  and  some  which  are 
unique.  A  node  tree  for  DOD  Logistics 
Support  Functions  is  shown  in  Figure 
3. 

A  structured  model  of  the  activities 
performed  by  the  contractors  and 
government  decision-makers  can  be 
the  basis  to  define  key  decision  points 
where  a  Support  Equipment  Decision 


Support  System  can  be  useful.  It  can 
provide  the  blueprint  for  the  construct 
of  such  a  system. 

Proposed  System  Architecture 

The  SEDSS  can  be  viewed  as  com¬ 
prising  three  subsystems.  The  Data 
Base  Management  System  (DBMS) 
provides  for  management  of  data 
structures  that  will  be  required. 
Organization  of  the  data  bases  will  be 
discussed  in  detail  in  the  next  section. 


DOD  UfOISTICS  SUPPORT  FUNCTIONS 


AO  Provide 
Logistics 
Support 


A1  Proviae 

Support  Acquisition 
And  Management 


A2  Provide  Training 


A3  Perform 
Maintenance 


All  Perform  Configuration  Management 
A12  Perform  System  Life  Cycle  Management 
A13  Perform  Resource  Planning 
A14  Provide  Support  Acquisition 
A15  Accomplish  Site  Activation 

A21  Define  &  Acquire  Training  Equipment 

A22  Develop  Courses 

A23  Conduct  Training 

A31  Provide  Maintenance  Management 

A32  Inspect/Diagnose  Failure 

A33  Perform  Repair  &  Check 

A34  Perform  Overhaul 

A35  Record  Maintenance  Action  Data 

A36  Perform  Failure  Analysis 

Generate  Redesign  Requirement 


Plan  Test  Program 


A6  Provide 

Supply  Support 


A61  Perform  Inventory  Management 

- A62  Acquire  Material 

A63  Store  and  Distribution 
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The  Model  Base  Management 
System  (MBMS)  provides  the  analysis 
and  interpretation  of  the  data  in  accor¬ 
dance  with  the  problem  posed  by  the 
decision-maker.  The  MBMS  would  be 
tailored  for  specific  users,  such  as  the 
SE  designer,  manufacturing  planner, 
and  SE  manager.  The  MBMS  could  in¬ 
clude  SE  design  retrieval  to  a  user- 
defined  specification,  application  of 
multi-attribute  utility  theory  to  rank 
order  equipment  features,  preliminary 
cost  estimates  based  on  cost  element 
drivers,  status  tracking  of  ordered 
equipment,  and  so  on.  The  MBMS 
would  be  constructed  to  provide  feasi¬ 
ble  alternatives  for  a  problem  faced  by 
a  decision-maker. 

The  third  component  of  the  SEDSS 
is  the  interface  with  the  user,  the 
Dialog  Generation  and  Management 
System  (DGMS).  This  system,  tailored 
to  specific  user  requirements,  presents 
the  SEDSS  outputs  to  the  decision¬ 
maker,  and  acquires  and  transmits  user 
inputs  to  the  DBMS  and  MBMS.  Possi¬ 
ble  dialog  formats  would  include 
menus,  spreadsheets,  graphs,  tables, 
etc. 


The  proposed  SEDSS  would  be 
distributed  geographically.  Data  bases 
would  not  reside  at  a  central  re¬ 
pository,  but  would  be  linked  through 
a  communications  network  that  was 
transparent  to  the  user.  The  MBMS 
and  DGMS  would  be  com-  posed  of 
modules  to  satisfy  requirements  of 
specific  decision-makers.  The  use  of 
top-down  architecture,  combined  with 
rapidly  building  and  demonstrating  a 
prototype  system  to  a  user,  can  ensure 
the  result  is  what  the  decision-maker 
requires.  The  natural  modularity  of  the 
architecture  readily  lends  itself  to  in¬ 
cremental  implementation. 

A  high-level  IDEFO  diagram  of  this 
process  is  shown  in  Figure  4.  Further 
decomposition  of  this  diagram,  if  done 
in  conjunction  with  developers  and 
users,  would  provide  a  coherent  view 
of  what  the  SEDSS  should  do  and  how 
to  achieve  it.  This  attitudinal  solidari¬ 
ty  among  the  many  government  and 
industry  users  of  SEDSS  will  be  critical 
to  its  success. 

Ideally,  the  system  would  be  in¬ 
dependent  of  the  type  of  computer 
equipment  and  operating  system  at  the 


user's  facility.  This  would  allow  users 
to  select  disparate  communication  net¬ 
works.  The  system  would  be  user 
friendly,  requiring  minimum  computer 
literacy.  The  system  would  be  menu- 
driven  with  multiple  forms  of  output. 

Proposed  Classification  and  Data 
Base  Scheme 

Fundamentally,  solving  the  SE  infor¬ 
mation  puzzle  requires  the  right  infor¬ 
mation  to  be  identified,  organized,  and 
made  available  so  that  it  is  readily 
usable  by  the  decision-maker.  For  ex¬ 
ample,  an  SE  designer  needs  informa¬ 
tion  from  many  weapon  systems  to 
discover  whether  existing  SE  can  be 
used  on  the  current  project  to  avoid 
designing  a  duplication  to  an  existing 
design;  or,  whether  a  modification  to 
an  existing  design  is  reasonable.  An  SE 
manufacturing  manager  can  use  de¬ 
tailed  information  about  SE  character¬ 
istics  to  plan  an  efficient  manufac¬ 
turing  process  rather  than  make 
repeated,  costly  small-batch  runs. 

Group  technology  (GT)  can  be  used 
to  organize  this  information  in  rela¬ 
tional  data  bases,  text  files,  and 
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graphic  data  bases  so  that  users  can 
easily  retrieve  and  apply  relevant 
analysis  tools. 

Once  data  are  organized  .hey  can 
be  loaded  into  a  base  where  a  Group 
Technology  Support  System  (GTSS) 
can  be  used  to  perform  basic  functions 
of  c<  eating,  modifying,  accessing,  and 
deleting  information  in  the  data  base. 

Classification,  used  in  the  GT  con¬ 
text,  relies  on  the  basic  principle  of 
developing  the  system  from  the  user's 
point-of-view.  Since  there  are  many 
users  whose  needs  must  be  met  for  the 
SEDSS,  broad  categories  of  informa¬ 


tion  are  suggested  to  capture  the  depth 
and  breadth  of  the  required  informa¬ 
tion.  As  discussed,  both  enumerative 
and  faceted  classification  approaches 
should  be  considered.  Figure  5  depicts 
data  files  currently  existing  for  most 
aeronautical  weapon  systems  that  af¬ 
fect  support  equipment,  and  which  are 
candidates  to  be  included  in  the  data 
base. 

The  proposed  classification  scheme 
centers  around  the  principal  attributes 
of  the  SE.  The  scheme's  purpose  is  to 
provide  a  consistent  communication 
tool  for  identifying  SE.  The  com¬ 


munication  tool  would  differ  from  user 
to  user;  i.e.,  a  design  engineer  requires 
different  information  in  a  different 
form  than  that  needed  by  a  manufac¬ 
turing  engineer  or  a  purchasing  agent . 
Supplemental  attributes  required  by 
different  users  should  be  stored  in  the 
data  base  so  that  each  user  would 
receive  only  the  information  needed  in 
the  most  useful  form. 

To  provide  a  data  system  that  is 
flexible  and  expandable  for  both 
volume  and  application  of  informa¬ 
tion,  SE  classes  already  used  in 
MIL-STD-846B  should  be  used  to  iden- 
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tify  function  as  the  major  attribute  to  may  be  housed  in  different  locations 

subdivide  all  SE.  A  proposed  classifica-  within  the  same  facility  but,  as  the 

tion  scheme  is  shown  in  Figure  6.  Per-  system  is  expanded,  data  bases  certain- 

formance  characteristics  should  be  sub-  ly  would  be  geographically  dispersed . 

classes  of  information.  Depending  on  The  key  point  is  that  the  user  would 

the  function  of  the  SE,  the  proposed  have  access  to  the  system's  information 

system  would  further  classify  an  item  at  the  individual  work  station.  For  all 

by  part  characteristics  and  provide  practical  purposes  the  fact  that  the  data 

broad  categories  of  information,  such  bases  are  distributed  should  be 

as  supportability  data.  transparent  to  users;  that  is,  a  user 

A  schematic  of  the  integrated  should  not  need  to  know  where  the 

distributed  data  bases  is  shown  in  data  is  stored  because  tasks  should  be 

Figure  7.  As  can  be  seen,  eventually  the  a  .  \°.  ,  Performed  if  data  were 

total  data  base  would  comprise  available  locally, 
numerous  data  bases  including  in-  The  system  designer  would  rely 
dustrial  and  government  data  bases  heavily  on  advanced  computer  com- 
1  ike  the  Logistics  Support  Analysis  Re-  munication  technology.  The  system 
quirements  (LSAR)  and  Lessons  data  base  would  consist  of  four  types 
Learned  data  bases,  housed  in  different  of  data  bases  linked  together:  GT, 
locations.  Initially,  different  data  bases  graphic,  relational,  and  text.  These 
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data  bases  would  be  heterogenous 
within  themselves  (each  may  comprise 
other  data  bases  linked  together)  and 
among  themselves  (different  types  of 
data  bases  may  be  located  on  different 
systems).  Some  of  these  data  bases 
may  have  to  be  built  from  the  bottom 
up,  while  others  could  be  readily 
adapted  from  existing  data  bases. 
Figure  8  is  a  schematic  of  this  concept. 

Program  Manager 


The  communications  link  would 
have  to  ensure  data  integrity  and 
reliable  delivery  of  information  in  a 
timely  fashion.  The  communication 
network  would  have  to  link  each  user 
to  every  other  user  to  optimize  infor¬ 
mation  utility,  and  it  would  have  to  be 
reliable  with  a  rapid  response.  It 
should  be  able  to  accept  read  and  write 
access  to  make  retrieving  and  updating 
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of  intormation  easy.  A  security  system 
tor  accessing  information  would  have 
to  be  employed  since  some  of  the  data 
may  be  company  proprietary.  A  cen¬ 
tral,  controlling  query  processing  site 
would  not  be  required  since  each  site 
would  be  capable  of  performing  all 
operations. 

Conclusion 

Substantial  savings  can  result  from 
streamlining  the  SE  acquisition  pro¬ 
cess.  A  preliminary  investigation  in¬ 
dicated  the  following  area  of  potential 
benefit  for  a  SED5S: 

—  Parts  range  in  commonality  of  func¬ 
tion  from  between  5  to  80  percent, 
depending  on  the  type  of  equipment. 

—  Design  time  can  be  reduced  25 
percent. 

—  Manufacturing  operations  are  com¬ 
mon  for  20  to  80  percent  of  the  parts 
produced. 

—The  SE  purchasing  time  can  be 
reduced  20  percent. 

A  Support  Equipment  Decision  Sup¬ 
port  System  can  substantially  improve 
productivity  of  the  SE  acquisition  pro¬ 
cess.  Development  of  the  SEDSS  must 
be  oriented  toward  supporting  the 
users'  decision-making  requirements.  It 
should  follow  a  well-structured  ap- 
proacn,  making  full  use  of  the  vast  ar¬ 
ray  of  systems  engineering  tools  and 
techniques.  The  system  should  be 
planned  with  a  comprehensive  top- 
down  architecture,  but  be  capable  of 
being  implemented  bottoms  up  as  a 
series  of  enhancements  to  the  SEDSS. 


It  should  optimize  the  application  of 
computers  for  tasks  in  which  com¬ 
puters  are  best  suited,  such  as 
repetitive  computations  and  data 
searching,  and  allow  human  decision¬ 
makers  the  freedom  to  employ 
creativity  and  logical  analysis.  The 
construction  of  a  prototype  system  to 
demonstrate  the  various  SEDSS 
capabilities  would  provide  valuable  in¬ 
formation  for  system  design 
refinement. 

Examples  of  how  the  system  could 
be  used  follow. 

Design  engineers  could  search  a  data 
base  for  items  of  equipment  which 
could  perform  a  desired  function  sub¬ 
let  to  a  list  of  constraints.  Designers 
could  effectively  identify  cost  drivers 
in  the  design,  and  perform  design/cost 
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trade  studies  using  historical  cost  infor¬ 
mation  keyed  to  cost  driver  elements 
in  the  design. 

Manufacturing  and  industrial 
engineers  could  use  the  data  base  to 
standardize  tools  and  equipment, 
thereby  reducing  number  ot  items 
manufactured.  The  make-buy  decision 
could  be  made  more  effectively.  Flexi¬ 
ble  manufacturing  work  cells  and  work 
centers,  specializing  in  families  of 
equipment,  could  be  developed.  These 
could  all  be  manual  labor  and  be 
totally  automated  or  be  semi- 
automated. 

Program  management  would  be  able 
to  reduce  its  considerable  oversight  of 
the  SE  process  without  sacrificing  con¬ 
fidence  or  integrity  in  the  process.  Cost 
comparison  of  SE  performing  similar 
functions  could  readily  be  madr  across 
weapons  systems.  A  formal  and  easi¬ 
ly  accessed  corporate  memory  for  SE 
could  be  established  within  the  Depart¬ 
ment  of  Defense. 

A  significant  issue  is  the  implemen¬ 
tation  and  maintenance  cost  of  the  pro¬ 
posed  system.  The  next  phase  of  the  in¬ 
vestigation  should  address  the  ques¬ 
tion:  Given  that  the  SEDSS  is 
technically  feasible,  which  elements  of 
it  are  worthwhile?  This  question  can 
be  answered  best  by  building  and 
evaluating  a  prototype  system. 
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